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1. Introduction. The primary focus of this paper is to obtain 
precise understanding of the distribution tail of hnear and related 

stochastic processes based on heavy tail innovations. In doing so, we 
will develop some new mathematical objects which are tailored to 
efficiently write and compute asymptotic expansions of these tails. 
Also, we will derive simple bounds of theoretical importance for the 
error between the tail and its asymptotic expansion. 

These tails and their expansions are of interest in a variety of con- 
texts. In the following subsection, we provide some typical examples 
to illustrate their use. The second subsection of this introduction 
overviews the new perspective and techniques developed in this pa- 
per; this will be done at a heuristic level, explaining the intuition 
and sketching the broad expanse wherein our methods lie. The last 
subsection contains basic facts on asymptotic scales. 

1.1. Prolegomenom. The first basic problem we will deal with is 
related to the tail behavior of the marginal distribution of linear 
processes. To be specific, let c = (cj)jgz be a sequence of real 
constants, and let X = {Xi)^^^ be a sequence of independent and 
identically distributed random variables. Let F be the common 
distribution function of these Xj's and write F = 1 — F the tail 
function. Assume that F has a heavy tail, that is, for any positive 
A, 

lim = A"" (1.1.1) 

for some positive and finite a. Let Gc be the distribution function of 
the series Y^i^zCiXi. Set Gc = 1 — Gc- For simplicity, assume 
in this introduction that the sequence c is nonnegative. Define 
Cq, = X^iez'^f- known that under a mild additional 

condition, 

at infinity, that is limt^oo Gc{t)/F{t) = Cq,. 

It is then a natural question to investigate higher order expan- 
sions. Under suitable conditions, we will obtain higher order asymp- 
totic expansions both for Gc and its derivatives. In particular all 
ARM A processes fall within the scope of our result, provided the 
innovation distribution satisfies certain mild conditions beyond that 
of heavy tail. 
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This question of obtaining higher order terms has several moti- 
vations. One is that very Uttle is known on the marginal distribu- 
tions of linear processes, and since those are ubiquitous in statistics, 
better knowledge and understanding of their properties is desirable. 
There are also specific instances where higher order asymptotics are 
needed, such as in the tail index estimation problem which we will 
study in section 4.2. To achieve such refined distributional results 
in this setting, we must first build the mathematical language and 
theory needed for higher order expansions. 

A third motivation comes from a large number of applications 
to related processes obtained by allowing the weights to be random. 
Whereas many first order results are known, few second order results 
exist, and no higher order results arc available that we arc aware 
of. We will obtain asymptotic expansions when the weights are 
random, not necessarily independent or identically distributed, but 
still assuming that the sequence c, now random, is independent of 
X. 

This will allow us to derive tail expansions for compound sums, 
that is a sum with a random number of summands. As a conse- 
quence, we will derive a tail expansion for some infinitely divisible 
distributions. In the same vein, having a result with random weights 
yields expansions for tails arising in transient renewal theory, and 
even in implicit transient renewal theory. By the latter, we mean, 
for example, distributions defined implicitly as follows. Let M, Q 
and R be independent nonnegative random variables and suppose 
that R has the same distribution as Q + AIR. Given the distribu- 
tions of M and Q, this defines that of R implicitly. We will obtain an 
asymptotic expansion for the distribution of R, when Q has heavy 
tail and M has enough moments. 

Furthermore, it will be clear that by the algebraic paradigm of this 
paper, it is quite a simple matter to write out what the expansions 
should be, and often not so difficult to prove that those expansions 
are valid under some reasonable conditions. 

In all the contexts mentioned, first order results exist under 
heavy tail assumptions, or more generally in the subexponential 
framework. By now, these results arc well understood. We refer to 
the book by Bingham, Goldie and Teugels (1989) for a comprehensive 
study of these topics and Broniatowski and Fuchs (1995) for a 
different perspective on first order results for sums of independent 
and identically distributed random variables. Resnick (1986) is 
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a good reference for many first order results obtained through a 
point process argument. In comparison, second order results are 
few. In the heavy-tail case papers which provide second order 
results for the sum of two random variables include Omey (1988), 
Geluk (1994), Geluk et al. (1997) and Geluk et al. (2000). With 
regard to subexponential distributions, second order work for a 
convolution of two such distributions may be found in Cline (1986), 
Cline (1987) and Geluk and Pakcs (1991). We also mention that 
Geluk et al. (2000) shows a second order result for a sum of a 
finite number of independent and identically distributed random 
variables in the special case of the underlying distribution being a 
member of the Hall-Weissman class. Barbe and McCormick (2005) 
obtained second order result for the sum of a finite number of heavy 
tailed random variables when the distributions also possess a mild 
smoothness property. Using a different set of assumptions and for 
a different purpose, Borovkov and Borovkov (2003) obtained higher 
order expansions also for a finite number of summands. 

In renewal theory, a little more is known. For instance, in recur- 
rent renewal theory, higher order results are already in Feller (1971). 
But our technique is useful only in the transient case, for which far 
less is known. Chover et al. (1973) provides a first order result while 
Griibcl (1987) gives a second order formula. In the implicit case, 
Goldie (1991) obtained second order formulas. However, our work 
complements nicely with Goldie's, in the sense that our results typ- 
ically apply when his fail. The techniques used by Goldie (1991) 
build on those devised by Kesten (1973) and Grincevicius (1975), 
and make use of delicate Tauberian theory, while that of Griibel 
(1987) is the so-called Banach algebra technique. Our technique is 
radically different from these. 

Griibel's (1987) result on renewal measures allows him to obtain 
a second order formula for the tail of some infinitely divisible 
distributions, using a decomposition which we could trace back at 
least to Feller (1971). We will use the same decomposition to obtain 
higher order results. 

Since our approach to deriving these asymptotic expansions may 
appear very algebraic to analytically oriented minds, we feel com- 
pelled at this point to quote a result which can be proved in less 
than 5 minutes after understanding the statement of our main re- 
sult (Theorem 2.3.1) and being familiar with our algebraic formal- 
ism. So assume that F is the distribution function defined by 
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F{t) = {a+b)-^{at-°'+bt-f^) for t more than 1, and with 1 < a < p. 
Assume further that the Cj's are nonnegative. Write Cr = YlieZ^h 
and 

1 f a 6 \ 

for the first moment of F. Then we have the two terms expansion 



a + b t"" 
( bCp 1 



if /3 < a + 1, 



+ < 



^^(6C/3 +a/iir,iQ!(CiC„ - Ca+l))^^ if ^ = Q! + 1, 
- C'a+l)-ZTT if Q; + 1 < ^. 



+ 



With our formahsm and notations to be explained later, this com- 
plicated formula has the far more manageable form, where no cases 
need to be distinguished. 



Note that if /? is a-l- 1, the Cj's and b can be chosen so that the above 
second order expansion yields only 

a + 

It is then desirable to get an extra term. In section 3.1, we will 
obtain this term, generically, when a is more than 2. We will also 
explain why in some very exceptional cases, obtaining a second term 
is rather hopeless (last example of section 3.1), while in other cases, 
obtaining as many terms as one desires can be trivial (penultimate 
example in section 3.2). 

To conclude this preliminary discussion, and perhaps to motivate 
further our investigation, we mention that there are many unsolved 
very basic problems related to linear processes. For instance, for 
discrete innovation, Davis and Rosenblatt (1991) show that all but 
trivial infinite order linear processes have a continuous marginal 
distribution; but there is still no good criterion to know if the 
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marginal distribution of the process is absolutely continuous. Even 
in the most basic cases, the behavior of the marginal distribution is 

amazingly difficult to analyze. Solomyak's (1995) breakthrough — 
a generic result on absolute continuity of the marginal distribution 
of first order autoregressive models with Bernoulli innovations — 
gives a chilling reminder on how little is known in general. So this 
paper can be taken as a contribution to the understanding of those 
distributions, in the continuous and heavy tail situation. 

1.2. Mathematical overview and heuristics. We now outline 
the mathematical content of the key parts of this paper and provide 
some intuition behind the main result. 

In our opinion, the main reason why so few higher order results 
are available in the problems we are interested in, is that too much 
emphasis has been given to an analytical perspective. Our first basic 
remark is that the convolution operation (F, G) ^ F -k G is bilinear 
and defines a semi-group. Bilinearity is a notion in linear algebra; 
while semi-group is related to the group structure, which in turn 
suggests representation theory. So our view is that the asymptotic 
behavior of the convolution semi-group should be analyzed by a 
linear representation which captures only the tail behavior of the 
semi-group. In fact we will obtain two linear representations, one 
which is suitable for writing the expansions, the other one, derived 
from the first one, and requiring more assumptions, suitable for 
practical computations. 

To explain further our view on the subject, let us give a heuristic 
argument on how to derive higher order expansions and build the 
mathematical language to handle these expansions. 

Heuristic. Let F and G be two distribution functions. Their 
convolution is 



The left hand side in this formula is symmetric, while the right hand 
side, as far as the notation goes, is not. To symmetrize it, we split 
the integral and integrate by parts to obtain 



F-kG{t)= F{t-x)dG{x)+ G{t-x)dF{x)+F{t/2)G{t/2) . 



This formula involves the translation acting on functions and 
defined by Txh{t) = h{t + x). The translations form a semigroup 
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since T^Ty = T^j^y. The corresponding infinitesimal generator is the 
derivative D, because for smooth functions 

hm ^^MO = lim + = Bh{t) . 

So, one expects to be able to write = e^^ — this is nothing but a 
neat way to write a Taylor expansion, which we could trace back to 
Delsarte (1938). Indeed, applying both sides to a smooth function h 
yields 

h{t + x) = T^h{t) = e-^'hit) = ^Ht) = 5^ . 

i>0 ' i>0 



So, formally, 

t/2 ft/2 ft/2 



F{t-x)dG{x)= f T_^dG{x)F{t) = j e-^° dG(a;)F(i) 

J —OO J —OO 



t /2 

As t tends to infinity, the linear operator e~^^ dG{x) should 
tend to the Laplace transform of G at D, say Lg(I)). So, ideally, we 
have 



F*G = Lg(D)F + Lj.(D)G + 0(FG). (1.2.1) 

Of course, for heavy tail distributions, many things are not well 
defined. Certainly, the Laplace transform does not exist, the distri- 
bution lacking sufficient intcgrability. 

So, consider the Taylor polynomial of the Laplace transform. 
Write fiG,k for the fc-th moment of G. Assume that these moments 
are finite for k at most equal to some m. The Taylor polynomial of 
the Laplace transform gives rise to the differential operator 

(-1) 



LG,m= E 



Assume that F and G are regularly varying of index —a, that 
is obey (1.1.1). Take m be an integer less than a. Throughout 
this paper, Id denotes the identity function of whatever space is 
under consideration. When using the identity on the real line, we 
write Id'^ for the function t ^ . So, ld~^F is the function whose 
value at t is t~"^F{t). We certainly would like to have the m-th 
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derivative F^™) regularly varying of index —a — m. In that case 
{Lq — Lo^rn)F could be of order smaller than the last term, that 

is F^"^\ or equivalently, Id~™F, and therefore dominates FG. So 
replacing Lg(D) and Lp(D) in (1.2.1) by /-G,m and /-f,™ and taking 
m less than a suggests 

FlTG = LcmF + LF^mG + oiU-'^F) . (1.2.2) 

The advantage of this substitution is that now everything is well 
defined, in particular it does not assume that F and G have moments 
of arbitrary large order. 

By induction, if we have n distribution functions Fj, 1 ^ i ^ n, 
we obtain 



*i^i^nFi= } + remainder. 

Taking limit at infinity yields a formula, which, restricted to the 
context of linear processes, is in fact the main result of this paper. 

The substantial task of transforming this heuristic argument into 
a rigorous proof will be carried out in sections 5, 6, 7 and 8. 

Going back to our heuristic, where is the representation which we 
announced? We will show that in the proper ring, that of polyno- 
mials in D modulo the ideal generated by D™+^, the composition 
of /-F,m with /-G,m givcs /-F*G,m- So the map F ^ Lp^m turns out 
to be a linear representation of the convolution algebra in a ring 
of differential operators. In this ring, the operators Lp^m will be 
invertible. 

This gives us a very powerful formalism to state expansions. But, 
arguably, it is not quite explicit. To obtain a powerful computa- 
tional machinery, we need to go from a ring of differential operators 
to a vector space where we can manipulate finite dimensional matri- 
ces. This is not always possible though, and it is related to a rather 
intricate matter concerning asymptotic scales. Those will be intro- 
duced in the next subsection and further examined in our context in 
subsections 3.1 and 3.2. 

Nevertheless, the basic idea is quite intuitive. For any positive 
real number c, write McF to denote the distribution function of cX,. 
More generally, when c is positive and /i is a function, we write Mch 
for the function whose value at t is h{t/c). Since DM(.F = c~^McDF, 
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the expansion (1.2.2) with m = 1 yields 



— C2lJ'F,iCi^ Mc-^DF + remainder. (1.2.3) 

This suggests that we could think of such expansion as a decomposi- 
tion in a basis comprised of F and DF, that is as a sort of projection 
onto the 2-dimensional vector space spanned by these functions. But 
there is a problem to overcome, namely that the sum M^^F + M^^F 
is not quite the usual first order result (c" + )-F. In doing such a 
replacement, we make an error, which may be larger than the second 
order term. So, even in an asymptotic sense, McF may not be in 
the space spanned by F and DF. We will give examples in sections 
3.1 and 3.2 showing incidentally that this problem is not a failure 
of the expansion, but that of the basis F, DF. This suggests that 
some bases are better than others, and of course raises the question 
of what is a good basis for our purpose. 

Since we will now be dealing with issues related to asymptotic 
analysis, we will switch to a terminology used in that field. Specif- 
ically, we will refer to an asymptotic scale for that which we called 
a basis in the previous paragraph. Asymptotic scales will be intro- 
duced formally in the next subsection. 

In studying linear processes, two operations are involved. One 
is the convolution obtained from summing independent random 
variables, the other is the scaling Mc obtained by rescaling the 
variables. We have seen that as far as the convolution goes, we 
have a representation using the differential operators /-f,™, which 
themselves involve D. This suggests that the good asymptotic scales 
are in some sense stable by differentiation and rescaling. In which 
sense? Since we are interested in asymptotic expansions, and we 
want to preserve the linear aspect of the convolution, they should 
be stable in the sense that derivative and scaling of functions in this 
scale should have an asymptotic expansion in the same scale. The 
simplest example of such functions arc the powers t~°'~'^, n G N. 
We will see many others. Wc call such stable scale a ^-asymptotic 
scale, and that will be defined formally in subsection 3.2. 

So, assume that e = (ej)^^/ is a set of functions defining our 
asymptotic scale. Then there exists a matrix T> = {T>ij)ij^i, such 
that for any i in J, the derivative Dej has asymptotic expansion 
Yljei'^i'j^j'i ^^'^ ^'^^ positive c, there exists a matrix Mc, such 
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that M^Bi has asymptotic expansion J2jei ^-^ciij^r particular, 
defining the matrix 

we see that LcmSi has asymptotic expansion Yljeii^G^j^i^j- Since 
the differential operators /-G,m are representations of the convolu- 
tion semi-group, so are the matrices Cq- This is our second rep- 
resentation of the convolution semigroup, which is now made up of 
finite dimensional matrices. Note that compared to the first rep- 
resentation using differential operators, we assume the existence of 
a :*r-asymptotic scale in which functions can be expanded. We will 
see that for usual distributions this is not a restriction at all, and 
it is even very natural and desirable. Also, the representation LF,m 
has dimension m + 1, while that given by Cp will often be of higher 
dimension. 

Now, if F has an asymptotic expansion Yliiei^F i^^^ expan- 
sion is encoded in the vector = {pp Then, the asymptotic 
expansion of McF is encoded in the vector McPp, which is simply 
a product of a matrix by a vector. Thus one can hope that because 
Lcm is a linear operator, LcmF has an asymptotic expansion en- 
coded by the vector is CcPp- In particular, formula (1.2.3) can be 
written as 

This means that we can calculate the asymptotic expansion of 
Mc^F -k Mc^F in a ★-asymptotic scale using multiplication and 
addition of matrices and vectors. The advantage of using this matrix 
representation is that we are now in the realm of linear algebra, where 
computers can be used both to do numerical and formal work. This is 
the key to efficient derivations of expansions in practical cases. One 
last point worth mentioning with regard to this algebraic approach is 
that the complexity of argument to obtain a higher order expansion 
is essentially the same as that to obtain a second order expansion. 
The effect of higher order is to raise the dimension of the space one 
works with; but, for second order and beyond, the spaces used will 
all have dimension at least 2. Only a first order result for which 
a 1-dimensional space suffices can attain a significant reduction in 
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effort. In the same vein, we note that expansions on densities and 
their derivatives are obtained with httle extra effort. Furthermore, 

these results are useful, for example, in discussing the Von Mises 
condition for infinite order weighted averages — see subsection 4.2. 

Of course, all this heuristic elaboration is rather formal at this 
point, and clearly the realization of this program requires us to define 
the proper analytical setup — this will be done in subsection 2.1 — 
as well as the algebraic machinery — to be done in part in subsection 
2.2 — simply to be able to state the proper theorem in subsection 
2.3. 

Up to now we have mainly presented the algebraic formalism. It 
is clear that in order to justify rigorously these heuristic arguments, 
one has to connect this formalism to analysis. As mentioned earlier, 
this is mostly done in sections 5, 6 and 7. At this point, it is not 
useful to outline the proof; such outline is given in section 5.2. But we 
mention that the proof is by induction on the number of summands, 
and then a limiting argument as the number of summands goes to 
infinity. Of course, any limiting argument in this type of asymptotics 
requires a good error bound between the original functions and 
their approximations, while induction somewhat requires tractable 
bounds. Those two requirements, sharpness and simplicity, tend to 
be in opposition. The key to obtain both features will be a functional 
analytic approach. We will write the convolution in terms of some 
operators, and the study of those operators will give us good bounds. 

The many steps alluded to in our heuristic arguments may suggest 
that particularly severe restrictions will be needed on the distribution 
function of the Xj's and the constants c. However, this is not the 
case and the main result is rather sharp. Before going any further, 
we mention that our asymptotic expansions involve derivatives and 
moments. It will be clear from the proof that some regularity of the 
underlying distribution must be assumed in order to obtain even a 
two terms expansion. The regularity assumption has a great impact 
on the form of the expansion. The assumption chosen hereafter, 
namely differentiability up to a certain order, seems the most natural 
one for applications to concrete distributions. In the same vein, 
Barbe and McCormick (2005) show that when a is 1 and the first 
moment is infinite, the truncated first moment is involved in a two 
terms expansion for finite convolution; moreover, the expansion takes 
a very different form if a is less than 1. It is quite clear from Barbe 



12 



and McCormick (2005) how some results of the present paper can 
be formally modified when one does not have enough moments. The 

overall philosophy of this work is to prove that in a natural setting, 
limit as the number of summands tends to infinity and differentiation 
can be permuted with asymptotic expansions. It is however a 
daunting task — if not hopeless — to prove a general theorem which 
could cover all possible cases. In particular, it is useful to remember 
that even for the convolution of two heavy tail distributions, there 
is no known second order formula that covers every possible case; 
however, we will provide some formulas or techniques which cover 
most distributions of interest in applications, if not all. 

1.3. Asymptotic scales. To conclude this introductory section, 
we present a few facts on terminology and notations related to 
asymptotic expansions. We refer to Olver (1974) for a complete 
account. 

Let be either a positive integer or +oo. A family of functions Cj, 
< N,is called an asymptotic scale if whenever i + lis less than 
N, the asymptotic relation e^+i = o(ej) — i.e. ej+i(t) = o[ei{t)) 
as t tends to infinity — holds. We say that a function / has an 
(n + l)-tcrms asymptotic expansion in the scale (ej)o^i<Ar if there 
exist real numbers fi, ^ i ^ n such that 

fit)= Mt) + o{enit)) 

as t tends to infinity. We then write 

f ^ fi^i- 

When n vanishes, this notation agrees with the more usual one when 
one writes / ~ 5 to mean that f/g tends to 1 at infinity. Sometimes, 
it will be more convenient to index asymptotic scale by an ordered 
set, and an obvious variation of the definition will be understood. 

However, this definition is insufficient for our purpose. The 
next step, following Olver (1974), is to introduce the notion of 
generalized asymptotic expansion with respect to an asymptotic 
scale Bi, ^ i < N. If there are functions ^s, ^ s ^ n such 
that for any nonnegative integer k at most n, 

f{t)= Yl Ut) + o{ekit)), 
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we say that J2o<i<n ^ii'^) is a (n + 1-terms) generalized expansion 
with respect to the scale ei, ^ i < N, and the developing functions 
(/){. We write 

/ ~ ^ . (e„) , 

or simply 

if the scale is understood. Note that there is no a priori under- 
standing that Cfc = o{(f)i) for any i between and n; in theory, it 
could be that the only information conveyed in the expansion is that 
/ = o(efc). 

It is important to note that once the asymptotic scale is chosen, 
the asymptotic expansion of a given function in that scale, if it exists, 
is unique. However, a generalized expansion may not be unique, even 
if one fixes the functions (pi. 

One should also be aware that the dependence of an asymptotic 
expansion on the asymptotic scale may be an important matter. For 
instance, write $ for the tail of the standard normal distribution and 
consider the asymptotic scale = $ , i G N*. Define the function 

2 

f{t) = + $ (t). One has the asymptotic expansion 

/ ~ ei + 62 . 

Clearly, this approximation cannot be improved. On the other 
hand, if one decides to use the asymptotic scale ej(t) = 
i = 0, 1, 2, . . ., one has for any nonnegative n 

/ ~ eo (en) . 

In this asymptotic expansion the part of / coming from 62 is not 

taken into consideration, despite the fact that in the chosen asymp- 
totic scale, the expansion has as many terms as one wishes. Finally, if 
one decides to use the asymptotic scale ei{t) = e~* /^/f\/27r, i ^ 1, 
then 

/ ~ ei + 2^(-l) . 

Again, in the asymptotic scale e^, i ^ 1, this asymptotic expansion 
has as many terms as one wishes though the term in 62 in / is not 
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taken into consideration. The term is effectively at every level of 
scale with respect to the asymptotic scale {ei)i^o or the asymptotic 

scale (ei)i^i. Moreover, this last asymptotic expansion is a divergent 
series, which gives a useless approximation if one does not truncate 
it. 

We highly recommend the short first chapter of Olver's (1974) 
book, where many simple examples are discussed; very useful, not 
so useful and totally useless expansions are shown; and the pros and 
cons of asymptotic expansions are well presented. 

2. Main result. 

To state our main result, we need to introduce two objects: 
the class of distribution functions we are dealing with and some 
differential operators which play a role in writing the asymptotic 
expansions. This is the purpose of the next two subsections. The 
main result of this paper is given in the third subsection. 

Let us now introduce some notation and conventions. 

We write !{•} to denote the indicator function of a set {•}. 

Throughout this paper we let Mc denote the multiplication oper- 
ator on distribution functions corresponding to the multiplication of 
random variables by c. Hence, if is a distribution function and X 
is distributed according to F, 

( F{t/c) ifoO, 
McF{t) = P{cX ^t} = I F{t/c-) ifc<0, 

[ I{ t ^ } ff c = 0. 

In the sequel, all distribution functions will be assumed continuous, 
thereby obviating the need for left limit notation. Note that for c 
positive, McF = McF, while for c negative, McF = /W_cM_iF = 
F{-/cj. For a general function h and positive c, we define also Mch 
to be h{-/c). 

2.1. The Laplace characters. Let D'" be the differential operator 
defined by D''h{x) = h^^\x) for any k times differentiable function 

h. As usual, we set D" to be the identity and = D. 

Recall that a linear differential operator with constant coefficients 
is a finite sum X]Q<j<^ PiD*- This is a polynomial in D, and the order 
of the operator is the degree of the polynomial. Thus, Pm is nonzero 
if and only if the previous differential operator is of order m. We 
write [ D ] the set of all linear differential operators with constant 



15 



coefficients and order at most m. It is naturally endowed with a 
vector space structure, corresponding to that of the polynomials. 
We will be mostly interested in a ring structure though. In M„[D], 
we define a composition as follows. If 

P= X] PiD* and 9 = J] H^' , 
are in [ D ] , we set 

In other words, we use for the ring structure of R^fD] that of the 
quotient ring of the polynomials in D modulo the ideal generated by 

Y)m+1 

In the following, we use the notation i^p^k for the moment of order 
A; of a distribution function F, that is / x'^ dF{x). In particular, ij,f,o 
is 1. 



Definition. Let F be a distribution function and m be an integer 
such that F has a finite m-th absolute moment. The m-th Laplace 
character of F is the element of R^ [ D ] defined by 



, _ . (-1) 

-F,m 



When m is clear from the context, we may simply write Lp. Observe 
that /-^j, is the identity. The origin of the term 'Laplace character' 
will be explained after our next proposition. 

Proposition 2.1.1. If F and G are two distribution functions with 
finite absolute moment of order m, then Lp^^ o = Lpi,G,m- 

Proof. The binomial formula shows that 

l^G,k-i I^F*G,k 



i\ (k-i)\ k\ ' 

The conclusion follows in an easy way from the definition of the 
composition. ■ 



16 



The previous proposition asserts that the Laplace characters are 
morphisms of semigroups. Since the maps F i— > fip^k are Hnear, 
the Laplace characters are representations of convolution algebras 
in Mm.[L)]- One may wonder if other representations exist, that 
depend on the distribution through some other set of characteristics, 
say for instance, moments of fractional order or quantiles. In fact, 
the answer is negative. By a recent result of Mattner (2004), the 
mapping of a distribution with m moments to its first m cumulants 
is universal among all continuous homomorphisms of the convolution 
algebra of distributions with m moments into Hausdorff topological 
groups. This implies in particular that one can express the Laplace 
characters in terms of cumulants. 

We can now explain our choice of the name 'Laplace character'. 
Formally, /-F,m is the m-th Taylor polynomial of the Laplace trans- 
form of F where we substitute the operator D for the variable. Hence 
the 'Laplace' part of the name. Equivalently, we could define Lk^^^ 
to be Ee~^^ in Mm[L)], where Y has distribution function K — 
note that with respect to Mattner 's (2004) result, it is clear from 
this definition that the Laplace characters can be expressed in terms 
of cumulants. Moreover, Proposition 2.1.1 shows that the Laplace 
character obeys a property very similar to the Laplace transform, 
namely that this trivializes the convolution into a product of poly- 
nomials (modulo an ideal here). This property is very similar to 
that defining the characters of a group, hence the name. There is 
an other reason for the use of the word 'character' which has to do 
with the fact that /-F,m can be viewed as a formal sum of differ- 
ential operators, which reminded us about the Chern character in 
algebraic topology. And we also observe that the representation of 
convolution algebra is pretty much the same as the representation 
of modules realized by the Chern character, our module being over 
the field of real numbers. 

One needs to be careful with one subtlety, namely that our 
composition in R„[D] is not the usual composition of operators 
acting on functions. If Ti and T2 are two operators, we write T2T1 for 
their usual composition, that is {T2Ti)h = T2(Tih) for any smooth 
function h. We then see that if i+j > m, we have D^D-^ = 0*+-^ while 
D' o D'' = 0. However, D'D'' is D* o D'' modulo an operator in the 
ideal generated by 0"^+^. This is in fact important (see subsection 
5.2). We could avoid this subtlety by defining operators acting on an 
infinite sequence of tuples of the form (Fj, f\^\ . . . , f\"^-^), i ^ 1. It 
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is really a matter of taste, and we feel that the framework proposed 
here is somewhat more convenient for our purposes. 

For computational purposes, it is of interest to note that operators 
in (Mm[D], o) which are not in the ideal generated by D — in other 
words, those which, as a polynomial in D, have a nonzero constant 
term — can be inverted. In particular, the Laplace characters can be 
inverted. To write an explicit formula for the inverse, recall that an 
ordered partition of length k of an integer n is a fc-tuple of positive 
integers p = {pi, . . . ,pk) such that Pi ^ P2 ^ • • • ^ Pk > and 
Pi + ■ ■ ■ + Pk = n. For such partition of length A;, it is convenient 
for what follows to agree on the notation pi = {) for all i larger 
than k. We write V{m,n) for the set of all ordered partitions of 
length at most m of n. For such partition p, we write Ap for 
{pi-p2,P2-P3, ■ ■ ■ ,Pm-Pm+i)- Also for a tuplc k = (fci, . . .,km) and 
an integer q we write (^) = (^^ ) the multinomial type coefficient 



Proposition 2.1.2. In ^^,[0]; fi'e have the inversion formula 



E ( E (-)-'(i;) n i^n 



Proof. In this proof we write i = {ii,---,im) a generic tuple of 
nonnegative integers, and \i\ = ii + ■ ■ ■ + im- In the space of power 
series in t, 



q\/{k^\ ■■■kj.). 




l^k^m 





Consequently, in 



■m 



[D], the inverse of Lp^j^ is 
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where the sum over i is over all tuples (ii, . . . , i^) such that \i\ = j 
and ii + 2^2 + • • • + mim ^ m. Set Pm+i = and pi = ii + pi+i 
for / = m, m - 1, . . . , 1. Thus, Pm = im, Pm-i = im + im-i, ■ ■ ■, 

Pi = ira^ hil. Setp = {pi,. . . ,Pm). Wc SCC that El^fc^m ^^fe = 

if and only if p is an ordered partition of n, and the correspondance 
between p and i is one-to-one. Moreover, \i\ =pi. Therefore 

^-.i-m E (-r(i;) n(^.«)'"'>". 

n^m pE.'P{m,n) l^fc^m 

which is the inversion formula. ■ 

To use Proposition 2.1.2, one may need to generate all the 
partitions of a given integer. We refer to Nijenhuis and Wilf (1978) 
or Stanton and White (1986) for algorithms related to that matter. 

Our next result is an other inversion formula for the Laplace 
characters. It is not as explicit as the previous one, because it is 
written in the ring (M^[D],o). However, we will make use of it. 
To write this inversion formula, for any differential operator T in 
(Rm [ D ] , o) and any nonnegative integer k, we define T°'^ inductively 
by T°° = Id and r°'= = T o T°^k-i)_ 

Proposition 2.1.3. In (M^[D],o), we have the inversion formula 

l-F^n= E (Id-^F,™)°^= E (-^yL°^,m E 

Proof. Since Lp^jyi — Id is in the ideal generated by D, it is nilpotent 
of nullity at most m + 1 in (M^[Z)], o). Consequently, 

^F,l„ = (ld-(Id-/.^,„))-'= E (Id-/-F,™)°^ 
Then, the second equality follows from the binomial formula 




It is also clear that there are other ways of thinking of the Laplace 
characters and their inverses that can be useful in applications. For 
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instance we can think of Lp ,^ as the m-th Taylor polynomial of the 
Laplace transform Cp (if it exists) of F evaluated at D. Then Lp\^ 
is simply obtained by taking the m-th Taylor polynomial of l/Cp 
and evaluating it in the variable D. 

There are other algebraic operations on Laplace characters which 
are of interest. For instance, we will use the McUin-Stieltjes convolu- 
tion between two distribution functions F and G on the nonnegative 
half line. It is writen F^ G, and defined by 

/"OO 

FXG{t)= / F{t/x)dG{x). 
Jo 

If X and Y are two independent random variables with respective 
distributions F and G, then F * G is the distribution of the 

product XY. Since E{XYy = EX-^EYK. the Laplace character 
of F ^* G is obtained by multiplying the Laplace characters of F and 
G coefl&cient-wise, that is 

Yet, another algebraic operation that one could consider, and 
which we will not use in this paper, is that of differentiating formally 
the Laplace characters as polynomials in D. Assuming that jjiF,k 
exists and does not vanish, writing dG(x) = n~^\x^ dF {x) , we see 
that /-G,m is {—\y/^iF.k times the A;-th derivative with respect to 
the variable D of Lp^m+k- 

Similarly, if F is a distribution on the nonnegative half line and 
G{t) = ijp\ /q F{x) dx, then 

l-G,m = —IJ'F\{I-F,m+1 — Id)/D . 

The interest of such algebraic formulas is to produce a form of 
operational calculus to derive tail expansions. This will be clear in 
section 3. 

We conclude this subsection with two lemmas. The first one 
is related to Proposition 2.1.1 while the second one describes the 
behavior of the Laplace characters under some multiplications. 
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Lemma 2.1.4. // H and K are two distribution functions with 
finite m-th absolute moments, then 

l-K*H,m = ^ ^ — tJ'H,jl-K,m.-j^'' ■ 

Proof. The right hand side of the equahty is 



Setting s = I + J, it is 

(—1)* /s\ 

2^ I{ j ^ S ^ m} — . )lJ-H,jlJ'K,s-j^ 



(-1)^ 



which gives the conclusion. 



Lemma 2.1.5. If K is a distribution function whose m-th moment 
is finite, then 

l-MxK,mMx = M\LK,m ■ 

Proof. It follows from the equalities 

'-MxK,m 



and the equality of the last term with M\LK,mh. ■ 

2.2. Smoothly varying functions of finite order. Among the 
regularly varying functions, the normalized ones will be of impor- 
tance to us. Following Bingham, Goldie and Teugels (1989, §1.3.2), 
we say that a function g defined on [a, oo) is a normalized regularly 
varying function with index p if it has the representation 

g{t)=tPce^p[ ^du, (2.2.1) 
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where e(-) is a function converging to at infinity. 

For any real number x and any positive integer fc, we write {x)k 
for x{x — 1) ■ • ■ {x — k + 1). We also set (x)o = 1- If is a function, 



Recall that a function h defined in some neighborhood of infinity 
is smoothly varying with index —a if it is ultimately infinitely 
difi'erentiable and 



for every integer k (see Bingham, Goldie and Teugels, 1989, §1.8). 

The set of all smoothly varying functions with index —a is written 
SR-a- The set of smoothly varying functions of a given finite 
order which we will define contains SR-a and can be thought of 
as a Sobolev space in the framework of regular variation. Before 
proceeding, it is useful to remark that for A; = 1 relation (2.2.2) forces 
h to be normalized regularly varying of index —a (see Bingham, 
Goldie and Teugels, 1989, §1.8). This and (2.2.2) forces /i^*^) to be 
regularly varying of index —a — k. 

Definition. Let m be a positive integer. A function h is smoothly 
varying of index —a and order m if it is ultimately m-times contin- 
uously differentiable and h^"^^ is regularly varying of index —a — m. 
We write SR-a,m for the set of all such functions. 

From Karamata's theorem, we see that a function h in SR-a,m 
satisfies (2.2.2) for any ^ k ^ m. Note that if mi is at most m2 
then SR-a,m2 is included in SR-a,mi ■ 

Also, if h belongs to SR-a,m, then all /t^'^^'s for A; = 0, 1, ... , m— 1 
are normalized regularly varying. Consequently, for any such k, 
the function t ^ t'^\h^''\t)\ is ultimately decreasing (respectively 
increasing) when a < a + k (respectively a > a + k) — see Bingham, 
Goldie and Teugels, 1989, Theorem 1.5.5. 

To define SR-a,s for a real number s, we write 5x for the point 
mass at x. Thus if /i is a function, S^h = J hdS^ = h{x). We then 
define the operator 




lim t^h^''\t)/h{t) = (-a) 

t— »oo 



k 



(2.2.2) 



a: 



t,x 



sign(x) 
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In other words, for any function g we set 



^t,x9 = sign(x) 



g{t{l - x)) - g{t) 



Definition. Let s be a positive real number. Write s = m + r where 
m is the integer part of s and r is in [0,1). A function h is smoothly 
varying of index —a and order s if it belongs to SR-a,m o,nd 



Note that m = m + 0, and that if h belongs to SR-a,m then (2.2.3) 
holds for r = thanks to the uniform convergence on compact 
subsets of (0, oo) theorem (Bingham, Goldie, Teugels,1989, Theorem 
1.2.1) 

When s is smaller than 1, the set SR-a,s is closely related to 
that of all the functions satisfying the Lipschitz condition [ ] of 
Borovkov and Borovkov (2002), while for positive m it is related to 
their condition [ D„ ] . 

Our next result shows that these spaces are nested. 

Proposition 2.2.1. If r is at most s, then SR-a,s C SR-a,r- 

Proof. If r or s is an integer, the result is obvious, hence we assume 
that both are not integers. Write r = m + p and s = n + a with m 
and n integers and p, a positive and less than 1. Let hhe a function 
in SR-a^s- If n is at most r, then m and n are equal, and p is less 
than a. It is then plain that h is in SR-a,r since the function 
is bounded in any neighborhood of the origin. 

Assume that n is larger than r. Then n is at least m + 1 and 



Since m + 1 is at least 1, the function ^('"+^) is regularly varying of 
index —a — m— 1. We write 



5^0 t^oo 0<|x|^5 



limlimsup sup \Al ^h^™'^ = . 



(2.2.3) 



lim t"'+^h^"'+^\t)/h{t) = i-a) 




to obtain 



i-p 



sup 



\th^'^+^\tu)/h^"'\t)\. 



1— x^u^l 
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Using the uniform convergence Theorem (Bingham, Goldie and 
Teugels, 1989, Theorem 1.2.1) and that p is less than 1, we conclude 
that 

limlimsup sup lA^^/i*^"*-*! = , 

5^0 t^cxD 0<|x|^5 

which shows that h belongs to SR-a,r- ■ 

Before going further, let us make a digression about condition 
(2.2.3). One may wonder about the analogous condition when r 
is 1. In fact, as we will explicate next, the condition (2.2.3) with 
r = 1 has bearing on several issues, e.g. understanding the spaces 
SR-a,ojj the monotone density theorem which is a classical result in 
the theory of regular variation, the class of asymptotically smooth 
functions introduced in Barbe and McCormick (2005) as well as the 
conditions [D] in Borovkov and Borovkov (2003). 

For clarity of the arguments, if a function g is differentiable, then 

Therefore, if /? is a positive number and if g' is regularly varying 
with index — /? — 1, 

lim lim A] g = l3. 

t— >CXDX— >0 

For r = 1, it is then natural to introduce the condition 

limlimsup sup {A] ^g - P\ = . (2.2.4) 

5^0 t^oo 0<|x|<5 



Proposition 2.2.2. The following are equivalent: 
(i) condition (2.2.4)- 

(a) g is normalized regularly varying with index —(5. 

(Hi) g is ultimately absolutely continuous and a version of its Radon- 

Nykodym derivative is regularly varying with index —f3 — 1. 

Proof. We write g a Radon-Nykodym derivative of g when it exists. 

We start by proving that (iii) implies (ii). If (iii) holds, by 
Karamata theorem (see Bingham et al., 1989, Theorem 1.5.11), 
Idg/g ^ —/3 at infinity. Integrating g/g gives (ii). 

Next, we prove that (ii) implies (iii). Consider the Karamata 
representation of g, 

g{t) =t~'^cexp 
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Such a function is ultimately absolutely continuous and a Radon- 
Nykodym derivative is 



P 

This implies (iii). 

We now prove that (ii) implies (i). Again, the Karamata repre- 
sentation of g yields for t large enough and x small enough, 



Kx9 



{l-xY 



X 



Let ry be a positive number and let ti be large enough so that g is 
absolutely continuous on (ti,oo) and the absolute value of e(-) is at 
most r] on (ii, oo). Then, for any t and t{l — x) more than ti, 

rtil-x) N 

-ri\ log(l -x)\^ J ^ du ^ r/l log(l - x)\ 



u 



- exp 

X 



For 6 small enough, this implies 



lim sup sup 

t^oo 0<|x|<5 

On the other hand. 



lim lim sup sup 

5^0 t^oo 0<|x|<5 



t(l-x) 



e{u) 



u 



du 



{l-x)-^-l 



X 



0. 



Therefore, (2.2.4) and (i) hold. 

We conclude the proof of the Proposition by showing that (i) 
implies (ii). We first note that if (2.2.4) holds, then g must be 
ultimately continuous; otherwise, the supremum in x in (2.2.4) would 
be infinite for some arbitrary large t's, precluding (2.2.4) to hold. 
Also, g does not vanish ultimately. So, without loss of generality, we 
assume that g is ultimately positive. Let gu and gL be the upper 
and lower derivatives of g, that is 



gu(t) = lim sup 
gL{t) = limjnf 



g{t + €)-g{t) 



g(t + e) - g{t) 
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Condition (2.2.4) implies that Idgu/g and Idg^/g have limit —(5 at 
infinity. Set f{t) = t^g{t). Since g is ultimately continuous, 



fu{t) = pt^-'g{t) + t^gu{t), 

and an analogous relation holds for the lower derivative of /. This 
implies 

tfu{t)/f{t) = p + tgu{t)/9{t) 

has limit at infinity, and similarly for the upper derivative. By 
Bojanic and Karamata (1963) — see Bingham et al. 1989, exercice 
1.11.8 — and Theorem 1.5.5 in Bingham et al. (1989), this implies 
that / is normalized slowly varying. ■ 

Note that Proposition 2.2.2 implies that if a function h belongs to 
SR-oi,m and (2.2.4) holds with /i^™) in place oig and (3 = a+m, then 
the existence of the derivative guarantees that h belongs to 

SR-a,m+i- However, without assuming that exists, (2.2.4) 

would only give existence and regular variation of a Radon- Nykodym 
derivative of h^"^\ 

The equivalence between (ii) and (iii) in Proposition 2.2.2 shows 
that the class of normalized regularly varying functions is a very 
natural one when dealing with regular variation of a function and its 
derivative. 

It also follows from Proposition 2.2.2 that the class of asymp- 
totically smooth distributions in Barbe and McCormick (2005) is 
in fact those which are normalized regularly varying; this was sug- 
gested to us by Jaap Geluk and prompted Proposition 2.2.2. It also 
shows that condition [Dm] of Borovkov and Borovkov (2003) relates 
to normalized regular variation. 

Proposition 2.2.2 is also interesting with respect to the monotone 
density theorem (Bingham et al., 1989, Theorem 1.7.2). Indeed, this 
theorem asserts that if a regularly varying function g with index 
— /3 has ultimately monotone derivative g', then this derivative is 
regularly varying of index — /? — 1; and moreover, by Karamata's 
theorem. Id g'/g ~ — /3. This implies that g is normalized regularly 
varying, and therefore satisfies (ii) of Proposition 2.2.2. In other 
words, the monotone density theorem can be viewed as a particular 
case of the implication of (iii) by (ii) in Proposition 2.2.2. This 
concludes our digression on condition (2.2.3) 
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The importance of the classes SR-ct,m in this paper stems from 
the nice behavior of their functions with respect to diflferentiation, 

global Potter type bounds, and to Taylor formula used asymptoti- 
cally. In order to elaborate on this assertion, recall first that Potter's 
bounds (see, Bingham, Goldie and Teugels, 1989, Theorem 1.5.6) as- 
sert that if is a function which is regularly varying with index p, 
then for any A larger than 1 and any S positive, there exists a to 
such that for any A at least 1 and any t more than to, 

A-'Xf-' ^ g{Xt)/g{t) ^ AY^' . 

This standard Potter inequality already yields an upper bound on 
the decay of the scaled derivatives of smoothly varying functions of 
fixed order. 

Lemma 2.2.3. Let h be a smoothly varying function of index —a 
and order s more than 1 . Let e be a positive number. There exists ti 
such that for any c positive at most 1 and any t at least ti and any 
integer k at most s, 

\iM,h)^''\t)\^2\i-a)k\c"-H-''\h{t)\. 

Proof. We have {M^hY^\t) = c'^h'^^^t/c). Since h is in S'i?-^,^ 
with s at least A;, there exists to such that for any t at least to, 

|t'=/tW(t)/Mt)|^x/2|(-a)fe|. 

Since c is positive and at most 1, the inequality t ^ to implies 
t/c^ to- Therefore, for t at least to, 

c-''\h^'\t/c)\ ^ V2\{-a)k\t-'\h{t/c)\. 

Now, if t is larger than some ti independent of c, Potter's bounds 
give \h{t/c)\ ^ ^/2c'^-''\h{t)\. This implies the result. ■ 

The following lemma shows that for normalized regularly varying 
functions, in particular for smoothly varying functions of fixed order 
at least 1 Potter's bounds can be improved by taking A = 1. 
Although this may seem a minor feature, this improvement is 
essential for our purpose. 
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Lemma 2.2.4. Let g be a normalized regularly varying function 
with index p. Let d be a positive number. There exists t2 such that 
for any A larger than 1 and any t at least t2 , 

X"-' ^g{tX)/g{t)^XP+' . 



Proof. Let e(-) be as in (2.2.1). Let t2 be at least a and such that 
suPt^t, \e{t)\ ^ 5. Then, 

9{t) ^Jt u )\^XP exp {-5 Jl^ u-^ du) , 

which yields the result. ■ 
To connect Taylor formula and asymptotic expansions, we set 

t^T 0<|x|^5 



Proposition 2.2.5. Let r be in [0,1]. If h is m times differen- 
tiable, then for any positive t and any u, 



J- 



Proof. The Taylor-McLaurin formula yields 

h{t + u)= V + + 

^ — ' 7! m! 

with Oi^u between and 1. The equality 

\h^^\t + et,^u) - h^^\t)\ = ^.v-nun/i^^^WIIAl,-.,,^^/*/.^™)! 

implies the result. ■ 

Observe that Lemma 2.2.3 asserts that if h is smoothly varying 
of order s = m + r, then h^'^\t) is of order t~'^h{t). Thus, the 
remainder term in Proposition 2.2.5 is expected to be asymptotically 
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rather small and certainly of smaller order of magnitude than any 
of the /t^-'^ (t) involved in the inequality of the Proposition. In other 

words, for functions in SR-a,s we can relate the local character 
of Taylor's formula to an asymptotic expansion of the translation 
u ^ t + u acting on those functions. The Proposition implies that if 
h is in SR-a,s, with s larger than m, then X]o<j<m(^''/iO^*'''''(0 
an asymptotic expansion of h{t + u) as t tends to infinity. Using the 
translation defined on functions by T^h^t) = h{t + x), Proposition 
2.2.5 asserts that is approximately the Laplace character 
when read on the tail of smoothly varying functions. 

Before moving to the next section, we make a remark concerning 
the behavior of the operator with respect to composition by 
differentiation and multiplications M^.. This remark does not have 
much intrinsic values, but we will need it during our proof. 

Lemma 2.2.6. For any positive c, the equality Aj^D'^Mc = 
^t/c,J^' holds. 



Proof. We have 



T>iM,h{t) = ^^^^ = c-^h^^\t/c) . 



Therefore, 



h^^Hit/c){l-x)) -h'<^\t/c) 



2.3. Asymptotic expansion for infinite convolution. To state 
our main result, recall that the ip norm of a sequence c = (cj)^^^ is 

This defines a norm only if p is at least 1. Nevertheless, we will still 
use the same notation with the same meaning when "p is less than 1. 
When p is infinite, |c|oo is simply the supremum of the |cj|'s. Given 
three nonnegative numbers a, 7 and w, we define 

TU — ^ wr)a/(a+(^)i I 
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This may or may not be a norm, according to whether or not 
70;/ (a + uj) and 7/2 are at least 1. For the values of 7 that we 
will use, that is 7 positive and less than 1, this is not a norm. 

The next theorem is the main result of the paper. It establishes 
a generalized expansion for some infinite weighted convolutions with 
respect to the asymptotic scale Id~*F, i ^ 0. To state this result, 
we need further notation. 

If F, G, H are three distribution functions, with H = F -k G, we 
write F = H\\G, the division of H by G. 

Note that if Cj is negative, then the upper tail of CiXi is driven by 
the lower tail of Xi. This induces some complications in stating a 
result for the tail of (c, X) because one needs stronger assumptions 
when the signs of the constants and the random variable can be 
arbirary. This explains the formulation of the next result. It does 
not cover all the possible variations, but seems to give what is needed 
in most applications. Other cases often may be obtained by simple 
changes in the proof. 

For two functions / and g, we write / x 5 to mean that the ratio 
f/g is ultimately bounded away from and infinity. 

In the following theorem, we write Gc for the distribution of 
'l2ieZ'^i-^i- Note that Gc^Mc^F is the distribution of that infinite 
series with the i-th term removed. 

Theorem 2.3.1. Let oj he at least 1. Let F he a distrihution 
function with F in SR-a^u- Let m and k be two integers such that 
m is smaller than a, and m + k is smaller than uj. Furthermore, if 
some Ci's are negative assume either that M^iF is also in SR-a,ui 
and M-iF ^ F or that F vanishes in a neighborhood of —00. 

Let J be a positive number less than uj — m — k and 1 . Then, there 
exists a function r]{-) converging to at infinity and a real number to 
such that for any t at least to, for any sequence c with iV„^^^(^(c) ^ 1, 



\t)n{t) . 



In particular for any sequence c with 



(c) finite, 
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This theorem calls for several remarks. 

Remark. By allowing a certain uniformity in the Potter type bounds 
and in the asymptotic smoothness assumption, a degree of uniformity 
in our result with respect to the underlying distribution F can be 
achieved. However, we choose not to develop such a refinement since 
it would entail a greater level of technicality which may be distractive 
to the main aim of the paper. 

Remark. When some Cj's are negative, the assumption F x M_iF 
is not necessary. It is quite clear from the proof how to modify the 
statement if we assume that M-iF is in some SR-p^i^f. However, 
the statement is far nicer when either both tails are comparable, or 
when F is supported by the nonnegative half line. 

Remark. When the q's are nonnegative, one does not really need 
to assume M_iF = 0{F). Certainly, the result holds provided only 
that the m-th absolute moment of the distribution is finite. This 
technical point appears in Lemma 6.3.1. 

Remark. If either k oi m are positive and their sum is less than 
w, then u) is more than 1, and the first sentence in Theorem 2.3.1 is 

not needed. Assuming that u is at least 1 is only needed when both 
k and m vanish; it is assumed only to ensure that F and possibly 
M-iF are normalized regularly varying. 

Remark. The analoguous statement on the lower tail holds as well. 

Remark. Since the Laplace characters are differential operators 
with constant coefficients, they commute with the derivative D. 
Consequently, Theorem 2.3.1 implies that for a certain class of 
distributions and sequences, taking limit with respect to the number 
of nonvanishing terms in the sequence c and differentiation can be 
permuted in an asymptotic expansion. It is quite striking that this 
can be done with some uniformity with respect to a rather large class 
of sequences. 

Remark. It will be clear in the sequel that the formulation of 
Theorem 2.3.1 is well suited for applications. One may still wonder 
if one can relax its assumptions on F. The example of first order 
autoregressive processes suggests that some refinements may be 
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given, but not in a fundamental way. Indeed, consider the sequence 
Cj = a* for nonnegative integers i, and Cj = for negative i. Thus, 
Gc is the distribution ofY = Yli>o (^^^i- For any integer k, set 



For fixed k, as i runs through the nonnegative integers, these 
random variables are independent and equidistributed. Moreover, 
Y = ^i^^ci'^^Zk^i. Hence, if the distribution function of Zk^i 
fulfills the assumptions of Theorem 2.3.1, one can obtain the tail 
expansion of Gc, even though the distribution of Xi may not satisfy 
the assumptions of Theorem 2.3.1. This may happen for instance if 
the distribution of Xj is a mixture containing point masses. Note 
however that the tail expansion will be expressed in term of the 
distribution of Z^^i and not of Xi. One would then need to relate 
the derivative of the distribution function of Zk^i to that of Xj. In 
the problem at hand, if Zk^i has a density for k large enough, then by 
increasing k, one can assume that this density is smooth. However, 
if no matter how large k is Zk^i does not have a density, then Y may 
still have one. As mentioned in the introduction, Solomyak's (1995) 
work is a cruel reminder on how difficult it is to study the marginal 
distribution of such a basic time series model. 

For more general linear processes, one could imagine to use similar 
blocking techniques. One would then need to extend Theorem 2.3.1 
in replacing the M^F^s by some more general Fj's, each Fj being 
in SR-a.i^- Formally, the expression is obvious to obtain. A proof 
along the line of Theorem 2.3.1 is possible under some assumptions 
on the -Fj's. However, it is not clear that such a refinement presents 
much interest in applications. There is in fact a great similarity with 
the central limit theorem for density, where one does not need the 
summands to have a density, but the characteristic function to be in 
some space with some r at least 1 (see Feller, 1971, §XV.5). Yet, 
in most real life applications — if not all — the local central limit 
theorem is applied when the summands have a well behaved density. 
The same seems true about the conditions of Theorem 2.3.1. 

3. Implementing the expansion. 

In this section we illustrate Theorem 2.3.1 and its implementation 
through examples. In the first subsection we discuss the number 
of terms in the expansion given by Theorem 2.3.1. In the second 
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subsection, we explain how for standard statistical distributions, 
matrix identification of the differential and multiplication operators 

provides a computationally efficient way to derive tail expansions. In 
the third subsection, we discuss an open problem related to second 
order formula for weighted convolutions under the assumption of 
regular variation with remainder. 

In what follows, if the sequence c is nonnegative, we write Cp for 
the series XligZ • When Cp+q as well as Cp and Cq are finite, we 
write Cp.q for Cp+g - CpCq. 

3.1. How many terms are in the expansion? Let us consider 
the expansion given in Theorem 2.3.1 for the tail of the distribution 
function, that is when k vanishes. It asserts 

Ge = 5^ LG^^M^^F,m'M:^ + oildT'^F) . (3.1.1) 

It seems that this formula provides an m + 1-term expansion. 
However, one should remember that the number of terms in an 
expansion depends crucially on the asymptotic scale chosen. In the 
case at hand, we will show that, for natural scales, this formula may 
give more or less than m terms. We suspect that this fact explains 
the failure of previous purely analytical attempts to find only a two 
terms expansion in the general infinite order case. The algebraic 
fiavor of the Laplace characters will be developed further in the 
next subsection, and will be the key to efficiently derive asymptotic 
expansions on specific distributions. 
When m is 1, formula (3.1.1) is 

Ge = Y.(m:J - f,GW.^F,iM:j') + o(ld-iF) . (3.1.2) 

For simplicity of the discussion, assume that the Cj's are nonnegative, 
and let us ask: how many terms does (3.1.2) provide? 

A naive answer is 2, for the first term is XlieZ ^aF^ while the 
second one is — Tliie'Ll^G\\M^.F,iMciF'- The following four examples 
show that the truth is more complex. 

Example 1. Take F{t) = i~"(l + 1/ logt) for t large enough. Then 
^ ' logt-logc/ 

logc 

= — I 1 . 

t« t« log t t"' log tlogt- log c 
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Moreover, McF'{t) ~ —ad^/t"^^ as t tends to infinity. Applying 
formula (3.1.2), we obtain 

G,(t) = ^ + -^(1 + 0(1)). 

The interesting point is that this two terms expansion is given by the 
sum Y.ie'L ^ciF; it does not involve the term Y.ie'L IJ'G\\m,^f,iM^.F' . 

Example 2. Take F{t) = + for t large enough, and 

assume that F is supported inside the nonnegative half line. This 
last assumption ensures that jip^i does not vanish. Now, 

F'{t) = -at-""-^ - (a + 2)i-"-3 . 

Consequently, (3.1.2) yields 

Gc{t) = C^r^ - at-^-^ Y.^C^ - + o(i-«-i) 

Therefore, if CiCq 7^ Ca+i, the first term is given by a contribution 
from X^jgx Mc^F, while the second one comes from XlieZ ^ci^' ■ 

Example 3. Take i^(t) = — t~"^~^ for large t, and assume now 
that F is symmetric. Hence ^p^i vanishes. Formula (3.1.2) yields 

Ge(i) = Cai""+o(i"""'). 

In some sense, the formula fails to give a two terms expansion. So we 
consider formula (3.1.1) when m is 2. Since jip,! vanishes, it yields 

G,{t) = Y.MZF{t) + \Y. f^Gi,M.^F,2MZF^'\t) + oit-'^-') . 

(3.1.3) 

Also, since ij.f,i is zero. 
Consequently, 

Gcit) = Co^t-'' + ^ ^(^2 - c2)Mf,2a(a + l)c°t-«-2 + o(r«-2) 

— 2 ^a;2AtF,2C +0(^1 j . 
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We see that the second term in this formula comes in fact from the 
third term in (3.1.1). Notice that the second term in the expansion 
for F played no role. 

Example 4- Let us modify example 2 in writing F(t) = t'"^ +at~°'~^ 
for large t. And let us take F to be symmetric. Formula (3.1.1) with 
m equal 2 yields 

Gc{t) = C^t-" + aC„+2r«-2 + ^(^±11^^,2 ^(C2 - c?)c°t-«-2 

+o(t-°-2) 

= C«t-" + (aC,+2 - 0.5a{a + 1)ixf,2C^;2) + o(t-«-2) . 

For any fixed sequence c = (cj)jg2 of nonnegative numbers, we can 
find a such that 

oCq+2 - 0.5a(Q! + l)fJ,F,2Ca;2 = . 

In this case, we need to include at least one more term, taking at 
least m = 3 in formula (3.1.1) if we want two nonzero terms. 

A first point of these examples is that obtaining simply a two 
terms expansion formula is rather hopeless in general. Clearly, some 
tricky cancelation may occur, depending on the particular sequence 
c considered as well as the coefficients in the expansion of F. 

A second point is that when some cancellations occur, we may 
need to add terms; at least if we can, since the condition m less than 
a caps the number of terms we can obtain. In our examples, this 
was easy, but in other cases, this may involve far more complicated 
calculations. Hence, we need more effective ways to implement the 
expansion, and this will be discussed in the next subsection. 

A third point is that it raises an interesting question: Is it possible 
that for any fixed m, as large as we want, can we find a distribution 
for which formula (3.1.1) provides only a 1 term expansion? We 
address this question in the rest of this subsection. The answer is 
yes, though it is not a generic case. To make this clear, let us examine 
the following statement. 

Statement. Generically, (3.1.1) with m equal 2 provides at least 
a two terms expansion, even if fip,! vanishes. 
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When m is 2, the right hand side in (3.1.1), up to the o(-)-term, 

is 

Let ajp be the variance of F. Since 

^J'G\^Mc^F,l = {Cl — Ci)fJ,F,l 

tJ'G\\M^^F,2 = {C2 - cf)ap + (Cl - Cj)^|u|^ 1 

and MciF"{t) ~ cfF"{t), as t tends to infinity, the formula reads 

- I (C„;24 + (ClC„;l - C« + l;l)/x|,,i)F'(t) + 0{F{t)/t^) . 

Generically, there is no cancellation, and even if ^uj? 1 vanishes, the 
term in F"{t) yields a nonzero term which (generically) does not 
cancel with YlieZ ^ci^. So, the formula yields at least two terms. 

The companion of the positive statement is as follows. 

Statement. Consider the formula (3.1.1) for both m, and the se- 
quence c = {ci)i^z fixed. Then there exists a distribution (depending 
on m and the sequence c) for which the formula yields only a 1-term 
expansion. 

We will prove this statement in the next section, once we have an 
effective way of calculating expansions. 

3.2. Practical implementation: from Laplace's characters to 
linear algebra. The few examples that we gave in the previous 
subsection were calculated easily by hand. In more complicated 
cases as well as for theoretical reasons (for instance to prove the 
statement at the end of the previous subsection), we need more 
effective ways to derive expansions. In Barbe and McCormick (2005), 
we introduced an algebraic technique, a tail calculus, which allows 
one to derive asymptotic expansions for finite weighted convolutions 
of distribution functions such that F{t) ~ t~"P{l/t) for some 
polynomial P. An extension to infinite order moving averages 
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was carried out for this class in Barbe and McCormick (200?). 
Distributions for which this calculus is applicable include the Pareto, 

Student and the Generalized Pareto. However, it does not apply to 
other well used distributions in the heavy tail literature. So we will 
develop a tail calculus for those. It may be possible to derive an 
abstract tail calculus which covers many more examples. However, 
we have not been able to find a good formalism for that purpose. 
Consequently we will say few things on the general idea, and mostly 
develop two examples. 

Generalities on tail calculus. Assume that we start with a distribu- 
tion function F such that F and M^iF have asymptotic expansions 
in an asymptotic scale e = {ei)i^i say. That is, for some coefficients 
PF,i and PMZ^^i, 

iei iei 

We write Pp and p^zTF vectors {pp^i)iei and {p-M-;p^i)iei- 

Note that since e is an asymptotic scale and both F and F are 
nonnegative, the first nonzero term oi pp and Pj/j-^ is positive. 
Writing |/| the cardinality of /, we can think of these expansions as 
a coding of the tails in the vector space R^'-'^l via the map 

p : F ^ p{F) = {Pp,Pm^) . 

The expansion in Theorem 2.3.1 involves multiplication by constants. 
Both the derivative D and the multiplication operators act 
componentwise on the scale e by De = (Dei)je7 and M^e = 
{McBiji^j. For every we can take linear combinations of the 
components of the vector e{t) by left multiplying it by a matrix. 
For vector valued functions, we extend the expansion notation ~ as 
acting componentwise. So, a vector valued function / = (/i, . . . , /p) 
has asymptotic expansion g = {gi,...,gp) if /j ~ gi for each 
i = l,...,p. 

Definition. An asymptotic scale e = {ciji^i is a -k-asymptotic scale 
if there exist matrices V and Mc such that De ~ Ve and for any c 
positive, McC ^ Mc^. 

In particular, in an asymptotic sense, a ^-asymptotic scale is 
closed under differentiation and multiplication of the variable by a 
positive constant. 
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For a ^-asymptotic scale, the following diagram commutes. 



Mr,F 

p 



Mc 



F' 



Mc 



T) 



iPp' ' PM-iF' ) 



In particular, the identification of tails with the finite vector space 
]^2|7| ij^^piigg i\\qX the operators T> and M. involved in the lower part 
of the diagram are simply matrices. This allows one to identify the 
Laplace character LK,m with the matrix 



K 



Note that this matrix depends on the order m of the Laplace 
character as well as on the ★-asymptotic scale chosen. The notation 
does not show this dependence. Theorem 2.3.1 implies that the 
following diagram commutes. 



F-kG 



{CfPq + jO-GPp, CfCg) 



In particular, the map F Cp is a linear representation of the 
convolution algebra, whose dimension is 

Practically, the diagram says that on a ^-asymptotic scale, asymp- 
totic expansions for weighted convolution can be done by manipu- 
lating finite dimensional vectors and matrices. This is the key to 
effective computation. 

In particular, using the existence of inverse for the Laplace 
characters, the asymptotic expansion of Theorem 2.3.1 is given by 

= ^GcJ^'mIf'^'^Mc, (I{ Ci>0}pp + I{ci<0 }pj;jz^) 
= ^Gc E ^mI^f^^Mc, (I{ q > }pp + I{ q < . 



This expresses the asymptotic expansion as sums and products of 
matrices. As we did in Barbe and McCormick (2005), this method 
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of calculation is suitable for computer implementation. It allows one 
to automatize asymptotic expansion for this type of weighted heavy 
tail convolutions. 

In the next two examples, we will work out the details and show 
how to obtain expansions with as many terms as the integrability 
condition m < a and computer memory allow. 

Distributions with asymptotic expansion of the form Yli^o . 
The Hall-Weissman (1997) distributions are defined by 

F{t) = at-'^ + bt-^ , 

with a < (3 and for t at least some ta,b- Obviously, they have an 
expansion of the form X]i>o Oit"'- 

The Burr distributions with positive paramters r and 7 are 
defined by 

F{t) = {l + t^/P)-\ t^O. 

When 7 is 1, it is also called the log-logistic distribution. A tail 
expansion is easily derived. Indeed, F(t) = P'^t~'^'^{l + pt~'^)~'^, 
and the expansion 

follows. This expansion is of the form X]i>o Qi^""'- 

The Frechet distribution is defined by F{t) = 1 — exp(— Its 
asymptotic expansion is given by 



Again, this expansion has the form J2i>o o^i* "* • 

So, it is of some interest here to consider an increasing sequence 
< ap < . . . < Op of real numbers, and investigate expansions for 
weighted convolutions of distribution funcitons having an asymptotic 
expansion in the scale ,0^i^p. For a more comprehensive list 
of heavy tailed distributions with examples of their use in modeling, 
particularly for insurance risk data, we refer to Beirlant et al. (1996), 
Embrechts et al. (1997) and Rolski et al. (1999). 
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Before proceeding, we need to note several things. There is of 
course no loss of generality in assuming that the coefficient of 

in the tail expansion of F does not vanish. Hence, we can assume 
that F{t) X f-"". Wc will apply Theorem 2.3.1 with A; = 0. This 
requires m < ao] and so, up to truncating the sequence, we can also 
assume that ap ^ ao + m < 2ao. The next thing to notice is that 
the asymptotic scale (t~"')o^i<p may not be a ★-asymptotic scale. 
Indeed, it is closed under differentiation if and only if for any integer 
^ i ^ p and any nonnegative integer k for which ai + k ^ a^, there 
exists a j such that ai+k = aj. If this is not the case, we enlarge our 
collection of a^'s by adding the missing ones recursively. Thus, we 
assume without loss of generality that (i~"')o^i^p is a ★-asymptotic 
scale. 

Now, let us consider the functions ej(t) = ^ i ^ p. They 

form the basis of a finite dimensional vector space, isomorphic to 
Since De^ = —aiCj with j defined by aj = CKj + 1, the 
derivative is identified to the matrix V defined by 

2)g. ^ I -ajCj if = + 1 ^ Qip, 
* 1 otherwise. 

Since V maps into the space spanned by ej+i,...,ep, it is a 
nilpotent matrix. 

Next, since McCi = c'^'-Ci, the matrix A4c is the diagonal matrix 
diag(c"')o^i^p. 

To show how this works practically, we consider the Burr distri- 
bution with 7 = 10 and r = 3/2 say (other values would work just 
as well). Then = = 15. Then, Theorem 2.3.1 allows for a 

14 terms expansion of the weighted convolution. However, we limit 
the expansion by chosing m = 4 in Theorem 2.3.1, though it will 
be clear at the end that to do so is motivated not by any difficulty 
in obtaining the terms in such high order expansion, but rather by 
concern with the space and display of such expansion. The Maple 
code that we used to implement the formal calculations is given in 
the appendix. 

So we choose m to be 4. Display (3.2.1) shows that F has an 
asymptotic expansion in the scale t-i5-3i/2^ i ^ 0. Since we want 
4 terms and t~^F(t) x we can restrict the range of i's to 

15 -I- 3i/2 ^ 19, that is i ^ 2. The expansion of F is then 

Fit) = I3^H-'' - 10/3"r33/2 + 55P'H-'' + o{t-'^) . (3.2.2) 
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So we need to consider the functions t~^^, t- 15-3/2 ^^j^^ t~^^. This 
family is not closed under differentiation modulo terms in o{t~^^). 
To close it, we need to add the derivative of t~^^ , that is up to a 
multiplicative constant, t~^^. But then we need to add the derivative 
of as well, that is to add t~^'^ . And similarly, we must add t~^^. 
Next we also need to add the derivative of which is up to 

scale t~^^~^/^. This process leads to the ir-asymptotic scale (ej)o^j^7 
corresponding to the following aj's: 

ao = 15 < 16 < 16 + 1/2 < 17 < 17 + 1/2 < 18 < 18 + 1/2 < 19 . 

Since we have eight a^'s, wc need to work in the space M^. 
Display (3.2.2) shows that 

F = /3i°eo - 10/5^^62 + 55/?^2e5 + 0(67) . 

So, the vector pp in is simply 

= 0, -10/3i\ 0, 0, 55/512^ 0, 0) . 

Since Dcq = — 15ei and De^ = —aiei+2 for i at least 1, the matrix 
that corresponds to the differentiation is defined by 

\ 






17.5 

-18 0/ 

Moreover, since McSk = c°"'ek, the multiplication operator is repre- 
sented by 

Mc = diag(c"'=)o^fc^7- 
A Laplace character Lk,4 is identified to the matrix 

Ck= J2 ^-^f^KjV^- 



( 

-15 




V 






-16 








-16.5 





-17 
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This shows that Cm^f is the matrix 

/ 1 

Ibcjii 1 

1 

120cV2 16c/Lii 1 

^c/ii 

680c3yL(3 1360^2 17c//i 

i^cV2 

V3O6OCV4 SlGcVs 153cV2 

Finally, Gc has an expansion whose coefficients are given by 

We formally compute the vector C~j^ pM-aPp- Assuming that 
the Cj's are positive, summing the vectors C~j^ p-^ciPp leads to 
expressions involving Cg = YlieZ^l- '^'^^ matrix Cq involves 
moments of Gc which in turn are expressed in terms of moments 
of F and other expressions involving the terms Cg ■ 

We can then compute the matrix for the Laplace character 
associated to G. We then do a formal matrix multiplication. To write 
the final result recall the notation Cp-q for Cpj^q — CpCq. We also 
write K3 for the third central moment of F, that is for E[X — 
and K4 for the fourth one, E{X — i^f^iY- We then proved that 
P{ (c, X) > t} has asymptotic expansion X]o^i^7 ^i^i with 

= /3'°Ci5 , 
qi= - 15/3iVi^^i5;i , 

Q2 = - 10/3^^^33/2 , 

93 = 120/3lV?(C^17;l - CiCi5;l) - 120/?lV2Ci5;2 , 

94 = 165/3^VlC33/2;l , 

95 = - 680/5iV?(Ci7:i - 2CiCi6;i + C^Cisa) 

+ 2040/3^VVi(Ci7;i - C2Ci5;i - 680/3^° K3Ci5;3 + 55/3^2Ci8 , 

96 = ^ Z^"*^^ (— ^l(C'35/2;l — C'lC'33/2;l) + '7^C'33/2;2) 

97 = 3060/3iV^(Ci8;i - 3CiCi7;i - 3C2Ci6;i - C^Cis;!) 







1 

1 

^-ciii 



18cui 1 / 
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- 18360/31 V2/v2(Ci8;i - C1C17.1 - C2Ci6;l - CiC72Ci5;l) 

- 9180/3lV^(2Ci7;2 - Cl5C2;2) 
+ 12240/3l°/t3m(Cl8;l - C3Cl5;l) 

- 990/3lViCi8;l - 3060/3l°K4Cl5;4 • 

It should be clear now that Theorem 2.3.1 is not a pure abstraction 
and that the algebraic nature of the Laplace character is what makes 
such a computation possible. 

The log-gamma distribution. Recall that X has a log-gamma distri- 
bution with parameter (A, a) if its density is given by 

/(^) = ^(logx)^-lx-«-^ x^i. 

This is equivalent to saying that X = exp(Z/a) where Z has 
a standard Gamma distribution with parameter A. Successive 
integrations by parts show that 

P{z>t}^^J2(^-i)kt^-'-K 

The distribution function F of X is given by P{Z ^ a log x }. Thus, 
it has expansion 

^(*) ~ - l)ka^-'-'(}ogt)^-'-' ■ 

This is an expansion in the scale efc(t) = t~"(logt)^~i~'^, A; ^ 0. 
Since 

e'.it) = '(logt)'-^-^(-«+ ^^^) , 

we see that = o(ei) at infinity for any i. Consequently, any 
finite family (ej)o^i^p is closed under differentiation up to o(ep+fc), 
k 1. Moreover De, = o(ep) implies that the matrix corresponding 
to derivative, T>, is 0. 

To determine the matrices A^c; we write 

e,{t/c) = c"t-"(logt)^-i-^ (l - 1^)'"'"' 

- E ^^-^-^'^^ -l)^c"(logc)V.W • 

fc^O 
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Hence, the matrix Mc is the lower triangular matrix defined by 

1 otherwise. 

(Note that we indexed our matrix so that the first row and column 
are labeled 0.) In particular {ek)k^o is a ^-asymptotic scale. Since V 
vanishes, the Laplace character of F is the identity. So the formula 
in Theorem 2.3.1 yields for any a more than 1, 

with 

A-1 (A- 1)2 (A-l)p N 
^ r(A) V ' a ' a2 ' • • • ' ; ■ 

Writing (C log C)r,s for YlieZ'^ii^^SCiY , we obtain for instance the 
asymptotic expansion 

with 

The interesting feature of this example is that for any m, the 
identification Cp oi the m-th Laplace character of F is the identity. 
A consequence is that in this asymptotic scale, increasing m in 
Theorem 2.3.1 does not yield extra terms compared to taking m 
to be 0. This is entirely due to the choice of the asymptotic scale. 
However, the expansion given in Theorem 2.3.1 provides in fact a 
better estimate. The reason is that the asymptotic scale in Theorem 
2.3.1 is adapted to the distribution function F and its derivatives. 
It is not a scale given a priori on which F is expanded. 

This situation is very similar to the fact that the normal tail 




has a one term expansion in the scale $ , A; ^ 1, say, but it has 
an expansion given by a divergent series in the asymptotic scale 

i-^e-*'/2. A; ^ 0. 
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A degenerate case. For the log-gamma distribution, we saw that we 
can find an asymptotic scale such that Theorem 2.3.1 with m equal 
provides as many terms as we like. In the example to be developed 
now, we show that the reverse situtation may occur; that is, due 
to rather exceptional cancellations, there are distributions such that 
Theorem 2.3.1 provides only 1 term. This was the statement ending 
subsection 3.1. For simplicity we will show this only when the q's 
are nonnegative. It is conceptually easy to adapt the proof if this 
does not hold. 

So, let us first choose m, as large as we want. Let a be larger than 
m, and let {ciji^x be a sequence of nonnegative numbers such that 
-^a,7,(^(c) is finite. We consider the ^-asymptotic scale ei{t) = 
^ z ^ m. As we have seen in the first example of this subsection, 
the derivative D is identified with the matrix V whose entries are 

jj, , ^ ( -a- j if z = j + l, 
''■^ 1 otherwise. 

Moreover, for any c positive, 

Mc = diag(c",c"+\...,c"+™). 

As before, the m-th Laplace character of F is identified with the 
matrix 

Let p = {po,... ,Pm) be the coefficients of the expansion of F in the 
asymptotic scale e^, ^ i ^ m. Then, the coefficients of Gc in this 
asymptotic scale are given by 

So, it suffices to prove that we can find F such that g = eo. Note that 
there is no loss of generality in assuming all the first m moments of 
F fixed, because fixing these moments does not put any restriction 
on the vector p. Hence the first m moments of Gc are fixed. In 
other words both the Laplace characters of F and Gc can be taken 
fixed. We already know that Cc^^m is invertible for it is a lower 
triangular matrix with all diagonal terms equal to 1. Along the lines 
of Proposition 2.1.3 we obtain an expression for the inverse of Cm^.f- 



45 



Specifically, we define the nilpotent matrix A/" = Id — CM^.F,m and 
have 

'CMt,F,™ = (id-Ar)-i= 

is also lower triangular, with its diagonal elements all equal to 1. 
Consequently, the diagonal elements of C~j^ Fm-^a those of 
Mci- Hence the matrix YlieZ^^ Fm-^ci lower triangular, with 
diagonal elements (Cq, Cq,+i, . . . , Ca+m)- It is invertible. Therefore 
it is possible to find p with positive eo component such that g is eg. 
This shows the existence of a distribution function F such that the 
formula in Theorem 2.3.1 yields only a 1 term expansion. 

This discussion is particularly relevant to the problem of as- 
certaining second order regular variation for infinite order mov- 
ing averages. If an m-term expansion shows that, for example, 
Gc ~ Id~° -|- Id""""*, then Gc is second-order regularly varying; 
but this would not be revealed until an m-terms expansion was cal- 
culated. Thus, we see that second order regular variation for linear 
processes is not a second order expansion question; rather, it is a 
higher order expansion question. We discuss this problem in detail 
in the next section. 

3.3. Two terms expansion and second order regular varia- 
tion. Motivated by probabilist and statistical applications, consider 
the following problem: If F is regularly varying of index —a with 
remainder, what is an asymptotic equivalent of Gc — CaF? 

In this section, we will first explain this problem and the termi- 
nology used, and then show that Theorem 2.3.1 sheds an interesting 
light on the matter. 

Recall that F is regularly varying with index —a and remainder, 
if there exist functions k{-) and g{-), with g tending to at infinity, 
such that _ 

^ _ A-« ^ \-"k{X)g{t) (3.3.1) 

as t tends to infinity — see, Bingham, Goldie and Teugels (1989, 
§3.12). Note that this relation does not change if we multiply g and 
divide k by the same constant. If this relation holds, then g must 
be regularly varying with nonpositive index p and, up to a possible 
multiplication of p by a constant, necessarily 

{XP-l)/p ifp<0, 
log A if /9 = 0. 



kiX) 
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We then write F G 2RV{—a,g). Unless otherwise specified, we 
assume for simplicity that the Cj's are nonnegative. The problem 
mentioned can be rephrased as: assuming (3.3.1), we know that F 
is regularly varying with index —a, hence that 

lim Gc{t)/F{t) = C„ . 

t—^00 

What is the exact rate of convergence in this limit? One would 
indeed think that adding one term to the regular variation as in 
(3.3.1) brings one more term in the asymptotic expansion for Gc- 
The examples in subsection 3.1 show that this belief is not correct 
in general. 

Since the problem is motivated by applications in time series 
where it is natural to suppose that F is centered, we assume that 
fiF,i vanishes — the following discussion can easily be modified if 
this first moment does not vanish. In order to apply Theorem 2.3.1 
with A; = and m = 2, we assume that F is smoothly varying of 
order larger than 2 and that a is larger than 2. We calculate the 
second Laplace character La^\^Ma.F,2 = Id + (l/2)^i?^2(C'2 — Ci)D^. 
Then Theorem 2.3.1, with m = 2 and k = 0, and the fact that 
F"{t) ~ a{a + l)t-'^F{t) at infinity, yield 

G,it) = J2^^^l^)- ^^^^C^,2l^p,2t-^F{t) + o{t-^F{t)) 

ie'Z 

as t tends to infinity. Consequently, 

The global Potter type bounds of Theorem 3.1.3 in Bingham, Goldie 
and Teugels (1989) and (3.3.1) imply 

^{t) - a = g{t) c°fe(l/c.) (1 + 0(1)) 

Consequently, one sees that the second order term depends on the 
behavior of t^g{t) at infinity. If limj^oo t^g{t) = oo, then 
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while if limj^oo t^dit) = then 

-=-[t) -Ca^ 2 L'a;2/^F,2r , 

with the usual convention that if the constant Ca:2 in the right hand 
side vanishes, then the right hand side should be read as o{t~^). If 
g{t) ~ at~^, then p is —2 and we obtain 



{t) ^Ga^ (^-a{Ca+2 - Go) - a{a + l)Ca;2/XF,2) • 



If the constant in the second order terms vanishes (which generically 
does not happen), then if we can, we need to add one more term 
when applying Theorem 2.3.1. But one should be careful that the 
rate of convergence of t^g{t) to its limit may cancel the extra term 
added. If cancellation occurs, then more terms are needed, and 
so on. It is therefore not clear that second order regular variation 
provides the right framework for studying second order expansions 
of Gc- In particular, for some exceptional sequences of constants and 
some distributions, higher order regular variation will be needed to 
obtain the exact second order. We also would like to point out that 
smooth variation of finite order is far easier to check than second 
order regular variation, and that it holds for most — if not all — 
heavy tail distributions used in practical applications. 

We conclude this section with a somewhat more general result 
to illustrate how weights of arbitrary signs appear in the expansion. 
If X is a random variable with distribution function F, we write 
Fh< the distribution function of \X\. Thus, on the nonnegative half 
line, = M^iF + F. In the statistical literature dealing with 
regular variation for the upper and lower tails of distributions, it 
is customary to replace (3.3.1) by a second order regular variation 
assumption on F*, that is, with the same notation as in (3.3.1), 

Eli^-X--r.\--k{X)g{t), 

and a tail balancing condition with remainder, that is for some 
nonnegative p at most 1, 

F=pF, + o(F,g) 
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at infinity. Set q = 1— p and 



i^c{X) = Y,{\/\ci\)-"k{X/\ci\){pI{ci >Q} + qI{ci<Q}) 

Define the constants 

C+,„ = and C_,„ = \cr • 



Furthermore, set 
and 



Ci>0 Ci<0 



C*,a;l — P{C+,a+l — C'lC'+,a) — Q'(C'-,a+l + ClC'-,a) ■ 

Assume that a is larger than 1 and that F satisfies the assumptions 
of Theorem 2.3.1 with m, = 1 and k = 0. Finally, assume also that 
a = limj^oo tg{t) exists, possibly infinite. Then, 

(aKc(A) — \~°'~^afiF,iC*,a;i)i~^ if o is finite, 
Kc{X)g{t) if a is infinite. 

We remark that the above results extend Theorem 3.2.III in Geluk 
et al. (1997). 

3.4. Some open questions. Formula (3.1.3) provides generically 
a two terms expansion when the mean fxp^i vanishes. For this 
expansion to be valid, we need a variance in order to define the 
second Laplace character. Consequently, we do not know what a two 
terms expansion is when the distribution pertaining to F is centered 
and has infinite variance; that is essentially in the range a between 
1 and 2. 

When a is less than 1, the mean does not exists, and we only 
have the classical equivalence Gc ~ J2iez ^ci^. Some examples in 
subsection 3.1 and the log-gamma distribution studied in subsection 
3.2 suggest that in some instances this equivalent may still provide 
two terms or more. 
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When a is less than 1 and F is concentrated on the nonnegative 
half line with smoothly varying tail of index a and order more than 
1, Theorems 2.5 and 2.6 of Barbe and McCormick (2005) imply a 
result for some finite convolutions. Specifically, define 

.1/2 

/(a) = 2 / ((1 - y)-" - l)ay-°-i dy + 2^° - 2"+^ . 
Then, if the Cj's are nonnegative constants. 

This suggests that under suitable conditions, the tail of the series 
Siez ^i^i should behave like 

YJA:J+^-^{CI- C^aW + o{F^) . (3.4.1) 

The techniques used in Barbe and McCormick (2005) combined with 
those of the current paper can certainly be used to prove (3.4.1). 
However, even in the case of a finite number of summands, when 
a is less than 1, we do not know a good formalism to remove 
the restriction that the support of the Mc^F's should be in the 
nonnegative half line. 

We believe that the techniques and formalism developed in the 
proof of Theorem 2.3.1 of this paper are generally useful for extend- 
ing a result from finite convolutions to infinite ones. Unfortunately, 
at the present time, finite convolution are still difficult to work with. 

4. Applications. 

In this section we develop some applications of Theorem 2.3.1 
and the tail calculus explained in section 3.2. As the section goes, 
these applications leave room to more and more questions; the last 
subsection, on implicit renewal equation, only touches on a subject 
which deserves further consideration. 

4.1. ARM A models. ARMA models are among the most used 
models in statistical analysis of time series. Yet, very few facts are 
known on their distributions. The purpose of this subsection is to 
show that in some circumstances. Theorem 2.3.1 provides some basic 
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information on the marginal distribution. We refer to Brockwell and 
Davis (1991) for the basic probabihstic and statistical aspects of 
these models. 

To fix notation, wc define the backward shift operator B on 
sequences as follows. A sequence x = (xj)jg^ is mapped under B to 
the sequence whose i-th element is Xj-i . As usual, is the identity, 
B~^ is the inverse of B, and B^ = BB^~^. It then makes sense to 
consider polynomials in B. Having two polynomials and $, and 
a sequence e = (€i)iez of independent and identically distributed 
random variables, an ARMA process X = {Xi)^^^ is defined by the 
relation 



For this process to be defined, we assume that 9 has all its roots 
outside the closed unit disk of the complex plane. We can define 
Q{B)~^ by a series expansion. Then, under a mild integrability 
condition on e, we obtain X = Q(B)~^^[B)€. Having a series 
expansion yields a representation of X as an infinite order moving 
average 



In general it is unknown how to calculate the marginal distribution 
of the process, that is the distribution of Xq. Since the roots of O are 
outside the closed unit disk, the sequence Cj decreases exponentially 
fast; see e.g. Brockwell et al. (1991, §3.1). Therefore, this sequence 
has finite A^a^-y^^-norm, whatever a, 7 and u are in the positive half 
line. Theorem 2.3.1 yields immediately an expansion for the tail of 
the marginal distribution of the process provided the distribution 
of the innovations has tail smoothly varying of sufficiently large 
order and index. 

To discuss further, let us write Gc the marginal distribution of 
the process. In order to make the expansion explicit, we need to 
evaluate the Laplace character /-Ccti/Wc F,m- This requires computing 
the moments of Gc\\MciF, or, equivalently, E{XQ—Cie-i)^ for various 
integers k. We do not know any way to obtain a nice formula for 
those moments in terms of the polynomials G and In general, one 
needs to rely on numerical methods. 

There are however two cases for which explicit calculations may 
be performed, namely for AR(1) and M.K{q) models, that is when 
either Q{B) =ld-aB and <^{B) = Id, or 6(5) = Id and # is an 



Q{B)X = $(B)e. 
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arbitrary polynomial of degree q. For instance, in many examples of 
section 3, the expansions can be expressed with coefficients involving 
the quantity Cp = J2ieZ^- ^'^^ AR(1), with autocorrelation a 
positive and less than 1, 

while for a MA(g) with ^{B) = Eo^i^g ^i^'^ 

By applying these formulas to the expression obtained in section 3.3, 
we obtain two terms expansions of the marginal distribution of these 
processes with an assumption of second order regular variation for 
the distribution of the innovations e. This will be used in the next 
subsection where we develop an application to statistical inference 
for heavy tail data. 

4.2. Tail index estimation. In heavy tail analysis, a critical 

parameter to estimate is the index of regular variation when the 
marginal distribution of the data has a regularly varying tail. In 
this example we are concerned with observations that follow a causal 
linear process which we denote (li),^^* • Thus, we assume that there 
is a sequence of real number q's and a sequence of independent and 
identically distributed random variables Xj's, so that 

By the first order result on tail behavior, we have that, if the dis- 
tribution function of the innovations X^'s has regularly varying tails 
with index —a, then the same is true for the marginal distribution 
function of the stationary linear process. The statistical problem is 
to estimate and find a confidence interval for a, based on sample 
data. 

The usual semiparametric procedure is to use the Hill (1973) 
estimator, defined as follows. Let |5^|j,n be i-th largest value among 
lYil, . . . , so that |^|n,n ^ ••• ^ l^|i,n- ^ct kn be an integer 
between 1 and n. The Hill estimator is 

an = kn(^ E lyV''"' 
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For this estimate to be consistent, it is necessary to take points 
coming from the tail of the distribution, and of course we need 
enough of them. This is expressed by the conditions 

lim kn/n = and Hm A;„ = oo . 

n— »oo n—>oo 

To derive a nondegenerate Umiting distribution, and therefore obtain 
asymptotic confidence intervals and tests, further hypotheses need 
to be imposed. These were obtained by Resnick and Starica (1997), 
and until the present paper could not be verified except maybe in 
some very special situations. To explain what the problem is, we 
need to list their conditions, and this requires further notation as 
well some rather technical consideration. 

Let be the distribution function of It is assumed that 
is second order regularly varying; that is, with the same notation as 
in section 3.3, F^.. belongs to 2RV{—a,g) for some regularly varying 
function g, i.e. (3.3.1) holds with _F* in place of F. Next, it is 
assumed a tail balancing condition holds, namely that for some p in 
the closed unit interval and q = 1 — p, 

F=pF, + o{gF,) (4.2.1) 

and 

'M~[F = qF,+o{gF,) (4.2.2) 

at infinity. This ensures that both F and M^iF are second order 

regularly varying, with same index —a and same auxiliary rate 
function g. The next assumption made is that F has a density 
F' which is Lipschitz in mean, that is there exists a positive k, for 
which 

/ \F'{x)-F'{x + y)\dx^Ky. (4.2.3) 

This condition ensures that the linear process is strong mixing. 

Note that so far all the conditions are on the unknown distribution 
of the innovations. In statistical analysis of heavy tailed time 
series, one takes as one's model assumptions that the innovation 
distribution satisfies certain properties such as we have listed above. 
Model assumptions are simply assumed to hold. However, conditions 
on the marginal distribution G may be worrisome. They may be 
redundant, i.e. one derivable from the assumptions on F, or they 
may even be inconsistent, i.e. the hypotheses for a theorem may 
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apply only to an empty class of models. For our particular tail 
estimation problem, we will elucidate this issue next. 

The next condition required is that the marginal distribution 
function G of the process satisfies a Von Mises condition, that is 
has a density G' and 

lim£^ = a. (4.2.4) 

Let G* be the distribution function of ll^l. It is further assumed that 
is second order regularly varying of index —a, using the notation 
introduced after (3.3.1), 

e2i?V(-a,pGj (4.2.5) 

for some regularly varying qq, ■ 
Yet, an other assumption is that 

lim ^/Kogo Gr(l - K/n) = . (4.2.6) 

n— ►oo 

Assumptions (4.2.4), (4.2.5) and (4.2.6) are rather problematic since 
they do not involve the distribution function of the innovation, and 

may potentially put rather stringent conditions on F or kn- We will 
investigate that matter after stating Resnick and Starica's result. 

The last assumption is on the sequence and presents no diffi- 
culty, since this sequence is chosen by whomever uses the estimator. 
It is assumed that 

lim sup n ' /kn < oo or liminfn^/V^n > 0. (4.2.7) 

Set 



Theorem 4.2.1. (Resnick, Starica, 1997). Assume that there ex- 
ists some u more than 1 and some positive constant A such that 
\ci\ ^ Au^'^ for any nonnegative i and that E\Xi\'^ is finite for some 

positive d less than 1. 

(i) If conditions (4-2.3), (4-2-4) and (4-2.7) hold, then 

\^i<'-T- r P{\Yi\ ^ xG-{l - kn/n)}—) 
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has a centered normal limiting distribution, with variance A. 

(a) If, furthermore, (4-2.5) and (4-2.6) hold, then y^{a~^ — a~^) 

has a normal limiting distribution with mean and variance A. 

Let us now show that Theorem 2.3.1 yields rather simple and 
explicit conditions which ensure that (4.2.4), (4.2.5) and (4.2.6) hold, 

and therefore makes Resnick and Starica's theorem far easier to use. 
Before stating the result wc introduce some conditions on the moving 
average weights. Recall at the end of section 3.2, we noted that 
in general higher-order expansions are required to determine the 
auxiliary function for an infinite order weighted average. In order 
that the derived auxiliary function be determined by only the second 
order information for the innovation distribution, certain restrictions 
must be met. They are encompassed in the following conditions. 
Similarly to C^, we define the notation 

Note that \C\r = |c|^. Recall that k{-) is the function appearing in 
the definition of second order regular variation for as in (3.3.1). 
Furthermore, the parameter p which appear in the function k is 
the index of regular variation of the function g. We will use the 
conditions 

\C\^ + pY,h\"ka/h\)^0, (4.2.8) 

and, with a a real number to be fixed later, 

a|CU + ap5^|Qrfe(l/|c,|) 

+ ap/Xi.,i(p-g)(Ci5^|Qrsign(ci)- 7^0, (4.2.9) 

as well as 

a\C\a + apY, |q|°A:(1/|c,|) - a{a + 1)//f,2(C2|C|„ - |C7|„+2) ^0. 

(4.2.10) 

We comment on those conditions after the following statement. 

Proposition 4.2.2. Assume that F and M^iF are smoothly vary- 
ing of index —a and order more than 1, and that they belong to 
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2RV{—a,g). Assume also that F' ultimately exists and is continu- 
ous. Then, 

(i) G obeys the Von Mises condition (4-2.4); 

(a) If F" exists and is Lebesgue integrable, then (4.2.3) holds; 

Next, let ^ = 1 if does not vanish, and ^ = 2 otherwise. 
Assume furthermore that F and M-iF are of order more than ^ and 
that a = linit^oo t^oit) exists, possibly infinite. 

(Hi) The function is second order regularly varying in any of the 
following three cases: 

case 1. a = +oo and (4-2.8) holds; 

case 2- a is finite, jjlf,! does not vanish, and (4-2.9) holds; 
case 3- a is finite, ijlf,i vanishes and (4-2-10) holds- 

(iv) Moreover, 



(v) condition (4-2-6) is equivalent to 

( lim„^oo VKg o F^{1 - knl n) = ifa^O, 
\ lim^^oo y/k^F^Ti'^ - kn/n)~^ = i/o = 0. 

Remark. When ij,f^i does not vanish, the result is obtained by 
an appUcation of Theorem 2.3.1 with m = 1; otherwise it requires 
m = 2. The all but intuitive conditions (4.2.8)-(4.2.10) are not there 
for technical reasons. If those conditions are not met as specified in 
the Proposition, then the last statement of the Proposition — the 
equivalence with (4.2.6) — does not hold. We would need to use 
Theorem 2.3.1 with a higher m or higher order regular variation, 
which would lead in some cases (but not always) to a different 
result. Note that generically, the Proposition covers all the cases; 
however, there are some exceptional cases where it fails. This is 
the very same phenomenon as that observed in subsection 3.1, and 
commented further toward the end of the proof of Proposition 4.2.2. 
This unfortunate fact commands caution when estimating tail index 
in time series. 

Remark. To fix the ideas, if F{t) x t"" and g{t) x t'f^ with /3 
positive and less than ^. In this situation, a is infinite. Then (4.2.6) 




and 
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is equivalent to = o{v?'^/^°'^'^f^^). One sees that the smaller (3 is, 
the smaller kn should be. In crafting a good estimator, one needs 
to be mindful of such restrictions when using the Hill estimator in a 
time series context. 

Proof, (i) We first set 

C+,„= < andC_,„= (-'^i)" 

ieZ;ci>0 ieZ;ci<0 

Recall the classical first order equivalence 

Applying Theorem 2.3.1 with A; = 1 and m = yields 

G' ~ Y.'V ~ + 9C_,,)(-a)Id-^F, . 

ieZ 

We then deduce (4.2.4). 

(ii) follows from the fundamental theorem of calculus as well as 
Fubini's theorem, writing 



j \F'{x)- F'{x + y)\dx ^ j J \F" {x + u)\dxl{0 ^ u ^ y} 

^y\F"\i. 



du 



To prove the other statements, we first derive a two terms 
expansion for G^.. We write Gc for G. Thus, M_iG = G_c- 

We first assume that fiF,i does not vanish. Since G* coincides 
with G + M-iG on the positive half line, Theorem 2.3.1 and the tail 
balance conditions (4.2.1), (4.2.2) imply 

G,=Y Lc^W.^F^Wy + E LG..^M.^,F,jr:y + o(Id-^n) 
ieZ ieZ 

ieZ ieZ 
+ o(Id-^F,) . 

We note that on the positive half line 
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Moreover, because F and M_iF are smoothly varying of order more 
than 1, we also have 

D/WeTF Q!ld"^7We7F. 

We then obtain 

+ anF,i ^{Ci - Ci){p - 5)sign(ci)Id"^M|c,|F^ + o{g)F^ . 
ieZ 

Consequently, we obtain the two terms expansion 
^ = \C\^ + Y.hrk{l/\c,\)g 

+ a//F,ib-g)(Ci5^sign(ci)|ci|° - |C|„+i)ld-^ + o(Id-^ V 3) . 

Let us now consider the case where vanishes. Again, Theorem 
2.3.1 and the tail balance conditions (4.2.1), (4.2.2) imply 

G.=^LG^i,M^^FM'M::F+M^) + o{ld-^F,) 

= Y^MZF + jr:y+^Y.^C2 - c?)d2(A4^ + 7^) 
+ o(Id-'n). 

Because F and M^iF are smoothly varying of order more than 2, 
we also have 

Then, up to o{ld~^F^), the tail G* is 

Y^M^, + ^a(a + 1) ^(C2 - c^)ld-'M^. 

= Y^-M^, + ^a(« + 1)(C2|C|„ - |C|„+2)Id-2F, . 

Therefore, we have the two terms expansion 
^ = \CU + Y.\c.mi/\c,\)g 

+^^^2^MF,2(C2|C|„ - |C|„+2)Id-2 + o(Id-2 V g) . 
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In either the case hf,i vanishes or does not vanish, we obtained 
an expansion of the form 



U + Vg + Wld-^ + o(Id-^ V g) . 



This imphes 



G^Xt) 



+A-"C/-iH^(A-« - l)t-^ + o(t-« V g{t)) . 



We now prove the result in case 1. Indeed, if a = hmj^oo t^9{t) 
is infinite, we have 



If 1 + pU~^V does not vanish, which is condition (4.2.8), this 
implies is second order regularly varying with auxiliary function 
proportional to g. 

The stated equivalence with (4.2.6) follows in this case from the 
fact that G^(l — u) >c F*^{1 — u) as u tends to 0. 

This proves statements (iii), (iv) and (v) in case 1. 

Note that as we have seen in section 3.1, if 1 + pU~^V vanish, 
we cannot conclude anything without obtaining higher order expan- 
sions, and virtually any auxiliary function may occur, either con- 
nected with higher order regular variation of F^, (here we are talking 
of third order or even higher order in exceptional cases) or the third 
terms in the expansion of G* (or higher order terms in exceptional 
cases) . 

Cases 2 and 3 are handled in the same way. ■ 

Example. To conclude this example we illustrate the result for a 
particular distribution. Consider a Student innovation density 



where is the normalizing constant and where a is more than 2. 

The Student distribution being symmetric, (4.2.1) and (4.2.2) are 
obvious. 



G.(At) 



A-« + A-«5(i)/c(A)(l + pU-^V) + o{g) . 
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To check the assumptions of Resnick and Starica's theorem we 
use Proposition 4.2.2. 

It is plain that F and M_iF are smoothly varying of order at least 
two, because the second order derivative of / is regularly varying. 
Also, / is continuously differentiable with integrable derivative; this 
establish that F" exists, is continuous and integrable. 

To prove that F is second order regularly varying, we derive a 
two terms expansion, writing 

/oo 

Jt 2 

Consequently, 

F{\t) - A-°F(t) ~ a("+i)/2K„||^±il(-A-"-2 + A-")t-«-2 

2(a + 2) ^^-^ 

Therefore, F belongs to 2RV{-a,ld~'^)- 

A first order analysis shows that G*^{l—u) x n^/°. Consequently, 
choosing kn = n^^l^'^^'^^ with Q positive less than 1 ensures that 
the condition listed in Proposition 4.2.2.f; is satisfied. For such 
choice, the second assumption in (4.2.7) holds. We conclude that 
the distributional assumptions in the Resnick and Starica theorem 
are satisfied. 

An example of a process where the theorem leads to a fully explicit 
result is the AR(1) model, = J^j^o''^'' ^n-j with |r| less than 1. 
In that case 

^_ l + |r|° 
~ a2(l - |r|°) ■ 



4.3. Randomly weighted sums. In this subsection, we consider 
a weighted sum X^iez^i^i' where the weights W = (Wj)jgz are 
random, independent of the Xj's. We also write {W,X) this series. 
Clearly, under some assumptions on the weights, the uniformity of 
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Theorem 2.3.1 allows one to obtain an asymptotic expansion for the 
tail of the weighted sum given the weights, and then decondition. 
This can be achieved with various integrability hypotheses on W, 
according to the arguments used in the proof. The one which 
we provide seems to work well for the applications which we will 
study. In particular, it does not add any moment requirement to 
the distribution of the Xj's. In applications, it is often assumed 
that the weights are nonnegative. This is not strictly necessary for 
deriving tail expansions, but it somewhat simplifies the statements 
and proofs. 

We will develop some applications in the next subsections. 

Before stating our main result on randomly weighted sums, recall 
that I • Ip is the ip-norm on sequences. Hence, when the sequence 
W is nonnegative, \W\p is i^i^z^iY^^ ■ '^^^^ always defined, 
possibly infinite. 

Theorem 4.3.1. Let F he a continuous distribution function, 
with tail F in SR-a,uj and such that M^^F = 0{F) at infinity. 
Let m be an integer less than a and uj. Let j be a positive 
number less than 1 and oj — m. Assume that F^"^^ is bounded. Let 
X = {Xiji^x ^6 a sequence of independent and identically distributed 
random variables having distribution F. Consider some random 
weights W = {Wiji^-^, independent of X, and such that for any 
1 ^ k ^ j ^m, 

E{\W\i-' \W\', )I{N„,,,UW) ^t} = o{t-^F{t)) (4.3.1) 

as t tends to infinity, and 

ENa,^,^ {Wr+''+' < oo . (4.3.2) 

Let Kw be the conditional distribution function of {W, X) given W. 
Then, 

P{ {W,X) ^ t} = Y,E^K^Ww,F,mM^{t)+o{t-^F{t)) 

as t tends to infinity. 

Remark. In the proof of Theorem 4.3.1, boundedness of F^™) is 
used only to prove that for any ^ j ^ m, the map {t, vu) i— > 
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F^^\t/w) is bounded on [l,oo) x (0,oo). For the conclusion of 
the Theorem to hold, it is enough that there exist to and M such 
that for any t more than to, for any integer i and for any integer j 
at most m, 

^ M a.s. 

In particular, when the WiS are less than a fixed number, this is 
implied by F belonging to SR-a,uj- For example, the case of the Wj's 
being Bernoulli random variables occurs in the analysis of randomly 
stopped sums. 

Proof. Let R be l/Na,j,u!{W). Define the sequence c = RW, whose 
elements are Cj = Vi/j/A^a,7,a)(W^)- Since Na^-y^oji') is homogenous of 
degree 1, this new random sequence satisfies Na^'y^u{c) = 1. Let Gc 
be the conditional distribution function of (c, X) given c. Let e be a 
positive real number. Let t2 be as in Lemma 2.2.4 as applied to the 
normalized regularly varying function F. Furthemore, let ti be at 
least t2, and such that the function r]{-) in Theorem 2.3.1 is at most 
e on [ti,oo). We apply Theorem 2.3.1 conditioning on W. So, on 
the event {Rt > ti}, 

\Gcm - LG^HM.^F,mMZFm I ^ {Rt)-^F{Rt)e. 

Let K be the (unconditional) distribution function of {W,X). 
Clearly, K{t) is the expected value of Gc{Rt). Taking expectation 
with respect to the sequence W in the previous inequality, 

I K{t) - J2 ELo^^M^^F^nM^iRt) I 

^ et-'^ER-'^F{Rb)l{ Rt^h} + EGc{Rt)l{ Rt^h} 
+ LGM,F,m'MZF{Rt) \l{Rt<,h}. 

The equality 

and Lemma 2.1.5 show that the left hand side of (4.3.3) is the 
absolute value of K{t) minus the asymptotic expansion given in the 
statement of the theorem. 
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To bound the right hand side of (4.3.3), the Potter bound in 
Lemma 2.2.4 imphes that for Rt and t at least ti, 

F{Rt)/F{t) ^ V R-') . 

Consequently, 

ER-^F{Rt)I{ Rt^h}^ ER-"'-'^{R' V R-')F{t) . 
Next, we have the obvious inequality 

EGciRt)I{ Rt ^h} ^ P{Rt ^h} = P{ Na,,-y,oj(W) ^ t/h } . 

Using our integrability assumption on the weights and Markov's 

inequality, this is at most o(t~"^F{t)). 

We now bound the third term in the right hand side of (4.3.3). Let 
be the distribution function of \Xi\ and let He be the conditional 

one of J2i€Z(^i\^i\ given c. Then, HG,\\M,.F,j is at most HH,,j- 

Consequently, 

E\LG,^M^^F,rrMJ{Rt)\l{Rt ^ h } 

^ J2 EfiH^jB^M:y{Rm{Rt^h}. (4.3.4) 

We then make use of the following claim which allows us to untangle 
the weights and the random variables X . It is a special case of a 
lemma in Chow and Teicher (1978, §10.3). It controls the moments of 
a deterministically weighted sum by that of the random variables and 
various -norms of the weights. Recall the notation Ck = YlieZ ^i- 

Claim. Let pkj = k — 1 + {j — k){j — k + l)/2. For any positive 
integer j less than a, 

Proof. The proof is that of Chow and Teicher (1978, §10.3) but with 
the constant made explicit. For any nonnegativc sequence (aj)j£^, 

{^aiY =^ai(ai+ ^ afe^ 
ieZ ieZ keZ\{i} 

^2-^(E«HE«^( E «^)"')- 

ieZ iei' kez\{i} 
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Substituting Ci\Xi\ for in this inequality and taking expectation 
on both sides with respect to X, 

ieZ fceZ\{i} 

The claim follows by induction. ■ 
Continuing the proof of Theorem 4.3.1, that is, to bound (4.3.4) 
from above, we have 

B^'M^{Rt) = R-m~^W>{t/Wi) . 

Since F^-') is regularly varying with index —a — j and bounded, 
since we also can assume that t is at least 1 say, F''^\t/w) is 
at most a constant times {w A 1)-'"'"""'^. In particular, the map 
{t,w) F^^\t/w) is bounded on [l,oo) x (0,oo). This fact, 

combined with the claim, show that (4.3.4) is at most 

0(1) Y E ECfCkR-^iRt^h}, 

that is 

0(1) J2 E E(j2wny~'Y^nnRt^h}. 

But one of our integrability assumptions implies that this last 
expression is o(t~"^F{t)), which concludes the proof. ■ 

4.4. Randomly stopped sums. Theorem 4.3.1 has many appli- 
cations in applied probability. In this subsection, we obtain a tail 
expansion for randomly stopped sums. Randomly stopped sums are 
a basic model in insurance mathematics, e.g. in modelling total claim 
size. A discussion of asymptotic behavior of random sums may be 
found in Embrechts et al. (1997). Some practical methods for ob- 
taining tail area approximations for compound distributions may 
be found in Beirlant et al. (1996). Willmot and Lin (2000) is a 
good source of information for compound distributions and may be 



64 



consulted for additional references; see also Willekens (1989). We 
further mention Omey and Willekens (1986, 1987) who obtained 

second-order results. We also mention Geluk (1992, 1996) who pro- 
vides second order results for subordinated probability distributions 
in the heavy tail case. 

Let N hea nonnegative random variable, independent of the Xj's. 

Define the sum = Xi-\ h X^, with Sq = 0. Consequently, we 

agree that F*^ is the point mass at 0. We write K for the distribution 
function of Sn- 

Theorem 4.4.1. Assume that F is a distribution function on 
the nonnegative half line, such that F belongs to SR-a,w Let m be 
an integer less than a and uj. Let ^ he a positive number less than 
u — m — k and 1 . If N has a moment of order more than 

a + m /a + u 



then, 



at infinity. 



7 \ a 
K = ENLp^iN-i) ^F + o(Id-'"F) 



Proof. Let W be the random sequence defined by Wj = I{ < z ^ 
N}. Then Sn = {W,X). To apply Theorem 4.3.1 with the remark 
following it, we need to check its assumptions, which is to check the 
integrability condition on the weights. Since 

1/ a 1\~^ l/a + w \ 

- /^T^ =-( V2 , 

'y \a + L0 2/ 7Va / 

we have 

Moreover, |W|i = N and = N'^- So the integrability conditions 
are implied by 

EN 7 (— 

and 

EN'^IiNy } = o{t-"'F{t)) . 

The first expectation is finite by assumption. For the second one, 
we apply the standard trick to prove Markov's inequality. For any 
p, the expectation is at most 

^jYm+p^-P7(j^Ai) _ 
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Take p such that the exponent of t is less than —a — m but such 
that EN'^'^P is finite. Use Proposition 1.3.6 in Bingham, Goldie 

and Teugels (1989) to conclude that the assumptions of Theorem 
4.3.1 hold. To conclude, note that for i positive and less than A'^, the 
equalities Mw,F = F and K\]Mw,F = F<^-'^^ hold. ■ 

As in Barbe and McCormick (200?) , using the Laplace transforms 
of Xi and N allows one to derive a rather neat expression. Indeed, 
setting 

Ax{t) = Ee-*^ and Ajv(t) = Ee'*^ , 
equality (2.2.1) in Barbe and McCormick (200?) yields 

ENL,.,.^..^ = - Y. l-ji ^'''(-'°f^"'"» (4.4.1) 



Then, the technique explained in Barbe and McCormick (200?) 
allows for efficient computation using computer algebra packages. 
Theorem 4.4.1 has an interesting special case. 

Corollary 4.4.2. Let F be a distribution function satisfying the 
assumptions of Theorem 4-4-F If ^ has a Poisson distribution with 
parameter a, then 

K = aLK,mF + o{Id-"'F) . 



Proof. The equality 

fe>0 fe^l ^ ^ 

shows that 

ENLp*(N-i) „i = aELp*N „^ = aLK,m ■ 

The result follows from Theorem 4.4.1. ■ 

4.5. Queueing theory. We consider a queue of M/G/1 type. This 
means that customers arrive with interarrival time exponentially 
distributed with mean fj,; the service has general distribution function 
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B with finite mean We assume in this application that the system 
is stable, that is (3/ fi is less than 1. Define 



Set a = f}/ 11. The Pollaczek-Hincin formula shows that the waiting 
time has the compound geometric distribution function 



We refer to Bingham, Goldie and Teugels (1987, p. 387) or Cohen 
(1972) for this derivation. If B is regularly varying at infinity, 
Cohen (1972) shows that so are H and W. When B statisfies 
the assumption of Theorem 2.3.1, higher order expansions can be 
obtained. We mention Abate et al. (1994), Abate et al. (1995), 
Abate and Whitt (1997) for recent related work. See also Willekens 
and Teugels (1992). 

Proposition 4.5.1. Assume that B satisfies the assumptions of 
Theorem, Let Ah be the Laplace transform of H. Then 



at infinity. 

Proof. Let Sn be a sum of n independent and identically distributed 
random variables having distribution function H. We set 5*0 = 0. 
We see that W is the distribution of Sn where N has a geometric 
distribution with parameter a. The Laplace transform of N is 



Therefore, for a random variable X having distribution H, 






+o(Id-™if) 



An{u) = (l-a)/(l-ae-'^). 



a;, (-log Ax (n 
Ax{u) 



{l-aAx{u 



-0,(1 - a) 



)) 
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Applying formula (4.4.1), we obtain the result. 



4.6. Branching processes Consider an age dependent branching 
process. Basically, this refers to a Galton- Watson branching process 
in which the particles have a random life time governed by a 
distribution F. The process starts at time with one particle; at the 
end of its life, it generates an average of p particles, which themselves 
at death will each generate an average of p particle, and so on. We 
refer to Athreya and Ney (1972, chapter 4) for a complete description 
of the process. It is intuitively clear that if p is less than 1, the so- 
called subcritical case, then the process will become extinct. 

Let i^(t) be the expected number of particles alive at time t. In 
the subcritical case, let also A'^ be a geometric random variable with 
parameter p, that is A" is a nonnegative integer k with probability 



Proposition 4.6.1. Assume that F is a continuous distribution 
function on the positive half line, whose tail F belongs to SR-ce,uj ■ 
Let m be an integer less than a and u). Then 



at infinity. 

Proof. As before, let us agree that is the distribution function 
of the point mass at 0. Equation (4) in section IV.5 of Athreya and 
Ney (1972) shows that 



{l-p)pK 



V = p-^ENLp.(,N-i)^^I{ N^1}F + o(Id"™F) 




Applying Theorem 4.4.1, we see that 



has asymptotic expansion 



p-\l- p)-^ENLp.,^-.,^J[{N ^ 1}F 



while 
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has asymptotic expansion 



(1 - p)-'ENLp.(^-i,^^I{ N^1}F. 
The result follows. ■ 

Let us now present an explicit expansion with m = 2. We write 
ap the variance pertaining to the distribution F. Direct calculation 
yields 

p-'ENLp.,...,^, = -^Id - 

+ ((1 - P^^'F + (1 + 2p)/^l,i)D' , 



so that 



1 - 2pi^F ^, 



1-p {1-py 

- (T3^(^^ - '^^^^ + + ^pWf,i)F" + '^(Id-'i^) • 

The first order term yields the result in Chover et al. (1973, p.296) 

and the first two terms yield the second-order result result in Grubel 
(1987). We refer to Pakes (1975) for related work in a subexponential 
setting. 

Note that if the Laplace transform of F is known, one could use 
Proposition 4.5.1 to obtain an alternative form of the asymptotic 
expansion. 

4.7. Infinitely divisible distributions. The infinite divisible 
distributions are those which for any integer n can be written as n-th 

convolution power of another distribution. They are also the limiting 
distributions of sums of n independent and identically distribution 
random variables when the distribution is allowed to change with 
n. We refer to Feller (1971) for an introduction to the topic. These 
distributions are characterized through their characteristic functions, 
which are of the form 

C e M ^ exp(irC - + I {e'<- - 1 - ij^) M^)) , 

where is nonnegative, r is a real number, u, the so-called Levy 
measure, has no mass at the origin and satifies / x"^/ {l + x"^) dz/(x) < 
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oo. Note that throughout this subsection, i denotes the imaginary 
unit; this is the only part in this paper where complex numbers are 
used. 

For what follows, it is convenient to set 

V{t) = v{t, oo) . 

Let Gjy be an infinitely divisible distribution function with Levy 
measure u. If has a regularly varying tail, then G ~ 17; see 
e.g. Feller (1971); see also Pakes (2004) for a related first-order result 
and Embrechts et al. (1979) for work in the subexponential case. 
Under a slightly stronger assumption, Griibel (1987) proved the two 
terms expansion 

at infinity. With our notation this means Gi, ~ Lg^^iV- 
The following result is then quite natural. 

Proposition 4.7.1. Let v he a measure such that V is smoothly 

varying of index —a and order to and v{—oo,—t) = 0{v(f)) as t 
tends to infinity. For any integer m less than a and lu, 

G, = LG^,rnly + o{ld-^V). 

In this expansion, the Laplace character LG,^,m involves the mo- 
ments of G,y of order at most m. These are finite when V is regularly 
varying of index less than — m and the right tail of u is dominant, 
that is under the assumptions of the Proposition. In practice, those 
moments can be computed by differentiating the characteristic func- 
tion of G,y. Again, computer algebra packages are wonderful for 
doing this type of work. 

Proof. The basic idea underlying the proof is a classical represen- 
tation of infinitely divisible distributions as convolutions of two dis- 
tributions, the first one having light tail, the second one being that 
of a randomly stopped sum with heavy tail. This makes it possible 
to use Theorem 4.4.1. 

Let A he a positive constant, and let a be the //-measure of 
[-A,A]''. Let vi be the measure iy{- n [-^4,^]'=), and let F be 
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the distribution function pertaining to the probability measure v^ja. 
Define 



X 



Ti=T - / ^ du(x) . 

The function 

H{0 = exp(iCn - + [\ - 1 - dKx)) 

is the characteristic function of an infinitely divisible distribution 
function H. Write F for the characteristic function of F and for 
that of Gv One has 

Cr^ = R exp(a(F - 1)) . (4.7.1) 

Let X = {Xi)i^i be a sequence of independent and identically 
distributed random variables, all having distribution F. They induce 
the partial sums 5„ = Xi + • • • + X^, with the usual convention 
So = 0. Let N he a Poisson random variable, with mean a. Let K 
be the distribution function of the randomly stopped sum Sjsf. One 
can check that the characteristic function of K is 

^ = exp(a(F- 1)) , 

so that Gi, = HK. Consequently, G^ = H * K. 

It follows from Corollary 4.4.2 that K ~ aLx^mF. 

The remainder of the proof is the only place in section 4 where 
we rely on results which we will establish in the proof of Theorem 
2.3.1. We write 

_ /■*/2_ /■*/2_ 

G{t)= I K{t-x)dH{x)+ 1 H{t-x)dK{x)+HK{t/2). 

J — oo J — oo 

As observed by Griibel (1987, proof of Theorem 7), the function H 
decays exponentially fast to at infinity. So 

G{t)= K{t-x)dH{x) + o{t-'^F{t)) . 

J -co 

If follows from Theorem 5.4.1, Lemma 6.2.1 and the asymptotic 
expansion of K that 



G{t)= ^^^t^Kj [ B^F{t-x)dH{x)+o{t-"'F{t)) 

= E ^^«/^KJ^^^,m-,D^T(t)+o(t— F(t)). 



3- 



71 



Applying Lemma 2.1.4, we conclude that 

G = aLK.H,raF + oild-"'F). 



Since K-kH is G^, and aF ultimately coincide with v, this concludes 



4.8. Implicit transient renewal equation and iterative sys- 
tems. A renewal equation is an integral equation of the form 



where H and K are given distribution functions, a is a real number 
and F is the unknown. Such equation is transient if the absolute 
value of a is less than 1 . These equations arise in applied probability 
and we refer to Feller (1979) for an introduction to renewal theory 
and Bingham, Goldie and Teugels (1989, §8.6) for basic results and 
references on the tail behaviour of the solutions. Following Goldie 
(1991), implicit renewal equations are equations of the same form, 
except that K is an integral transform of F. Again, these equations 
appear in applied probability and statistics, in connection with the 
stationary solution of iterative systems. 

The purpose of this subsection is to show that in some cases, 
one can derive an asymptotic expansion of the solution by solving 
linear equations. This method is radically different from that of 
Kesten (1973) or Goldie (1991); it works under a different set of 
assumptions, closer to the one used by Grey (1994). The appealing 
feature of this approach is its simplicity of implementation. The idea 
is very simple: expand the known function on an asymptotic scale; on 
this scale, the implicit renewal equation becomes a finite dimensional 
linear system, which can be solved by elementary linear algebraic 
techniques. Consequently, we obtain an analogue of the technique 
to solve differential equations using formal series expansions and 
identifying the coefficients. Of course, this technique will only work 
for a limited type of renewal equation. 

To explain the principle, we first look at a simple renewal equa- 
tion. 

Standard renewal equation. Assume that H and K have moments of 
order m. Then the renewal equation gives m equations determining 
the moments of F, that is 



the proof. 



F-aFi.H = K 
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This can be rephrased in a nicer form with Proposition 2.1.1, which 
combined with the renewal equation imply 

l-F,m — al-F,m ° t-H,m = LK,m ■ 

When the absolute value of a is less than 1, the operator Id — aLn^m 
is not in the ideal generated by D. Therefore, it is invertible in 
(M^[D],o). This implies that for \a\ less than 1, 

LF,m = (Id - aLH,m)~^ o LK,m ■ (4.8.1) 

So, we can calculate the Laplace character and the moments of F. 
This calculation is done by manipulating finite dimensional matices. 
Iterating the renewal equation yields 

F = J2a'K~kH*\ (4.8.2) 

Hence, F converges to 1/(1 — o) at infinity and its tail is given by 
{1 - a)-^ - F = ^a'K i< H*K 

Define the distribution function G by G = 1 — (1 — a)F. It solves 
the equation 

G-aG*H = (1 - a)K. (4.8.3) 

Similarly to what we did in subsection 3.2, assume that K and H 
have an asymptotic expansion on a ★-asymptotic scale e. It is then 
conceivable that G has an expansion in that scale. Then (4.8.3) and 
Theorem 2.3.1 yield, with notation analogous to that of section 3, 

Pg - ai^GPn + ^hPg) = (1 - ^)Pk ■ 

That is, is the solution of a linear system of equations, and can 
be made explicit by the formula 

= (Id - aCn)-^ ((1 - a)f>^ + aCGPij) ■ (4.8.4) 

In this formula, Cq involves the moments of G and those are 1 — a 
times the moments of F; these can be calculated by solving the linear 
system (4.8.1). Having an expansion for G it is then trivial to derive 
one for F. 
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The only thing missing to make this rigorous is to prove that G 
has an asymptotic expansion in the same asymptotic scale e as H 
and K. This is trivial because, when a is positive, representation 
(4.8.2) shows that G is the distribution function of the sum of a 
random variable with distribution K and a randomly stopped sum 
having a number of summands distributed according to a geometric 
distribution with parameter a; and then Theorem 4.4.1 applies. 
When a is negative, one uses the same argument but split the sum 
in (4.8.2) into one where the index i is odd and one where the index 
is even. 

An implicit renewal equation. Following Goldie (1991), Grey (1994), 
Grincevicius (1975) and Kesten (1973), consider the distributional 
equation involving random variables, R = Q + MR where (M, Q) 
and R are independent and all random variables are nonnegative. 
We need one important extra assumption, namely that M and Q 
are independent. It would be desirable not to make this assumption, 
but this would require some interesting generalization of Theorem 
2.3.1. To write the implicit renewal equation equivalent to this 
distributional identity, let ^ denote the Mellin-Stieltjes convolution. 
That is, if F and H are two distribution functions. 



The connection with iterative systems is that if {Qi,Mi), i ^ 1, 
are independent, all distributed as {Q,M), then, under suitable 
conditions, the sequence Rq = 0, Rn = Qn + M^Rn-i has a 
distribution converging to that of R, that is to _F — sec for instance 
the survey article by Diaconis and Frccdman (1999). We mention 
that first-order asymptotics for random coefficient autoregressive 
models is consider in Resnick and Willekens (1991). 

Let H and K be the distribution functions of M and Q respec- 
tiveley. The distributional equation is equivalent to 



Let us assume that K has a tail expansion in a ★-asymptotic scale 
e as in section 3.2. Equation (4.8.5) yields two equations: one on 
the Laplace characters, which allows us to identify the moments of 
F, one on the tail vectors Pp, pj^, which allows one to find the tail 
expansion of the solution. 



H%'F(t) 




F = Kic{H*F). 



(4.8.5) 



74 



For any integer k for which the A;-th moments of K and H exist, 
the moment equations are 



IJ'F,k = 



y] ( ■]fiK,jfJ-H,k-jfJ'F,k-j 



These equations allow one to find the moments iJ,F,k by induction on 
k. 

If F has an expansion in the scale e, then (4.8.5) and Theorem 
2.3.1 suggest that 

Pf = ^hXfPk + ^KPj^ . 
Since the variables are nonnegative, 

H*F{t) = jF{t/x)dH{x)= j'M^{t)dH{x). 

Consequently, 

P]^ = J MxdH{x)pp. 

Thus, we obtain the tail expansion of F in the scale e, whose 
coefficients are given by 

Pp={ld-CK j Mx dif(x)) ^Cjj^ppj^ . (4.8.6) 

Again, for this to be justified, we only need to prove that F has an 
expansion in the scale e. Our next result gives a suflBcient condition, 
and a complete example of application follows its proof. 

Proposition 4.8.1. Assume that K satistifies the assumptions of 
Theorem 4.3.1. If EM^'^'^^"'^'^^ is less than 1, then formula (4.8.6) 
holds. 

Note that by Jensen's inequality, the integrability assumption in 
Proposition 4.8.1 implies that E' log Mi is negative, and therefore, 
that the implicit renewal equation has a well defined solution. 

Proof. Let Qi (respectively Mi), i ^ 1, be a sequence of independent 
random variables all having the distribution K (respectively H). 
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Let Wq = 1 and for k at least 1, let Wk = Mi...Mk. Under 
the assumption of the Proposition, R has the same distribution 

as "^-^^QiWi-i. Therefore, we will derive the proposition from 
Theorem 4.3.1. So, we need to check that (4.3.1) and (4.3.2) hold. 
Referring to (4.3.1), we set p = j — k. Clearly p + k is at most m. 
Moreover, define 



1 a 

- A — ■ — , and q 

2 a + u 



a + m ^ 
IP 



Furthermore, set s = ^pq. Note that = o(t~"^F{t)) at infinity, 
for s is more than m + a. 

Applying Holder's inequality, we bound the expectation involved 
in (4.3.1) by 

iE\W\''/\W\f)^/^{EN^,^,UWf'y^'t-' ■ (4.8.7) 

Now, 

\W\l^\W\f = (2p)!2! Yl • • • ^"..^4,+. (4. 

ni<---<n2p+2 

+ other terms where rii = rij for some distinct i and j. 

In all the terms in the right hand side of (4.8.8), the Af^'s arc raised 
to a power at most 2{p + k), which is at most 2m. Concerning the 
first sum on the right hand side. 



ni 



n2—ni n.2p+i— n2p n2p+2— n2p+i 



_ , "1 ,,n2-ni »2p+l— »2p "2P+2— »2p+l M 8 Q"! 

~ pH,2p+2kP'H,2p-l+2k ' ' ' P'H,2k P'H,k \'i.O.\)) 

By Lyapounov's inequality, for j at most 2m, the inequality jiu,] ^ 
I^H^-hn liolds. Therefore, (4.8.9) is at most iJ,H,2m at the power 

^ {{2p + 2k)ni + {2p - I + 2k){n2 - ni) + ■ ■ ■ 

+ 2k{n2p+i - n2p) + k{n2p+2 - "2^+1)) • 

This exponent is at least 

^ (fcni + k{n2 - ni) H h k{n2p+2 - "2^+1)) = ^^2m^ ' 
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Our moment assumption and Lyapounov's inequality imply that 
fJ'H,2m is less than 1. Consequently, (4.8.9) is at most f^'fjlm^^'^"^- 
For n2p+2 fixed, there are at most n^^2 integers ni, . . . ,n2p+i less 
than n2p+2- Therefore, the first sum in the right hand side of (4.8.8) 
is at most 

which is finite. 

The other sums in the right hand side of (4.8.8) are similarly 
shown to be finite. 

So, to check (4.3.1) it remains to prove that Noi^'y,u{WY'^ has 
finite expectation. It suffices to show that -E|W|^* and £^|W|^ are 
finite. 

We have 



i^l il,---,i2q 



Again, this sum involves Mj's raised at power at most 2q^p, that is 
2s, which is less than 2{a + m + ^p), which is less than 2{a + m + l). 
By assumption, /i_f/,2(Q+m+i) is less than 1, and the same argument 
as before shows that is finite. 

Finally, note that 



Since (a + m + l)/s is more than 1, this shows that |W|^ has finite 
expectation. 

Finally, it is now straigtfoward to check that (4.3.2) holds. ■ 

Let us now give an explicit example. Its purpose is to show 
that it is now easy to obtain the tail expansion, at least when the 
assumptions of Proposition 4.8.1 are satisfied. So for our example, 
take H to be the exponential distribution function of mean 6, 

H{t) = 1 - e"*/^ , t^O, 
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and K to be the Pareto distribution 



K{t) = !-{! + 1) 



—a. 



To check the assumptions of Proposition 4.8.1, we calculate 



It is natural to consider the asymptotic scale ej(t) = with 
i positive and less than a. We will derive only two terms, again not 
because of the difficulty of getting more, but for the space of writing 
the coefficients. So we assume a larger that 1 and derive a two terms 
expansion for the solution of (4.8.5). 

In the chosen scale, pj^ = (1 —a)*. As wc have seen in section 
3.2, the matrix representing the derivative is defined by Pcj = 
— (a + i)ej+i, that is 



The first moment of the Pareto distribution is /i^,! = ^/i<^ ~ 1) 
while that of the exponential distribution is fJ-H,i = 6- So the 
moment equation is 




Therefore, the condition of Proposition 4.8.1 is simply 



-l/2(a+m+l) 




The matrix representing the multiplication is 




AtF,i = fJ-K,! + IJ'H,ilJ'F,i = (a-l) ^ + efj,F,i ■ 



Therefore, 



fiF,i = l/{l-9){a-l). 



We then evaluate the matrices involved in (4.8.6). So, 




1 
a/(a-l) 1 
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and 



J Ma: dH{x) = J diag(x", x"+^)^-^e-^/^ dx 

= e"T{a + 1) 
After some elementary calculation, 



1 
0{a + l) 



\ea/{l-e){a-l) 1 

Now, applying formula (4.8.6), we proved that F has an asymptotic 
expansion F ^ Pp qCq + Pp -^ei with 



( 1 \ 

g"r(a + l)(g - g + gg) + g - 1 - 
V"(l - a)(l - B){\ - e°r(g + 1))(1 - ^°+^r(g + 2)) / 



To conclude this section, we mention that there are other parts of 
mathematics where regular variation plays an important role is dif- 
ferential equations; see for instance Marie and Tomic (1977), Omey 
(1981) and Marie (2000). Since the asymptotically smooth functions 
of fixed order can be differentiated a certain number of times, they 
form a natural class to use in differential equations. The general 
philosophy of this paper could be applied to some of these equa- 
tions. Moreover, because of Theorem 2.3.1 it is possible to obtain 
asymptotic expansion for some integro-differential equations involv- 
ing convolutions, Mellin transforms, multiplication by a function, 
nonlinearity due to taking powers of the unknown function and sim- 
ilar features for which we can find a stable asymptotic scale. 

5. Proof in the positive case. 

In this section, we prove Theorem 2.3.1 under some extra assump- 
tions. Throughout this section, we suppose that F'^^^ is bounded and 
Lebesgue integrable over the positive half line. More importantly, we 
also suppose that both the Cj's and the Xj's are nonnegative. Since 
Z and N* are in bijection, there is no loss of generality to index our 
sequence (cj) by N*, which we will do throughout the proof. In the 
first subsection, we derive an expression for convolutions which will 
be suitable for our analysis. In the second subsection, we outline the 
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proof. The third subsection contains some basic facts about regu- 
larly varying functions and tail estimates. Subsection 4 contains a 
key estimate. Then we prove some basic lemmas (subsection 5) and 
finally conclude the proof by induction. 

There will be many results during the proof which state that some 
term A say is at most some term B. In some cases, nothing prevents 
a priori B to be infinite. However, at the end, we will see that all 
the upper bounds are indeed finite and prove the theorem. 

During the proof, M denotes a generic constant which may change 
from place to place. This constant 'depends' only on F and lo. 
Also several of our lemmas below have conclusions which hold for all 
sufficiently large reals. The bounds above which these conclusions 
hold are denoted by ij. These ij's only depend on F and lu. 

Since we consider nonnegative Cj's thoughout this section, we 
assume without any loss of generality that the sequence (c„)„^i is 
nonincreasing. It is also understood that except in subsection 5.1, all 
distributions in the current section are supported by the nonnegative 
half line. Recall the notation Cg for the sum of the c|, that is, in 
this section, Cs = J2i>i ^f- 

Note also that since lo is at least 1, the function F is normalized 
regularly varying. 

5.1. Decomposition of the convolution into integral and 
multiplication operators. Let ii' be a distribution function and h 
be a function integrable with respect to the measure dK. For any rj 
between and 1, define the operator 



Recall that for any positive real number c, we defined the multipli- 
cation operator on functions 



Note that if a random variable X has distribution function F, then 
cX has distribution function Mf.F. Moreover, for any c nonnegative. 




h{t - x) dK{x) . 



Mch{t) = h{t/c) . 



It is then natural to define, when possible, 




if t ^ 0, 
if t < 0. 



M^F = McF. 
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These operators allow us to write convolutions and their derivative 
in a way that will be suitable for our analysis. 

Proposition 5.1.1. Let F and G be two distribution functions. 
For any rj between and 1, 

F-kG= TG,i-r,F+ TF,r,G + Mi/nFMi/^i_n)G . 

Let k be a positive integer. If F and G are k times differentiable, 

When k = 1, the sum X]i<i<o ™ proposition must be read as 
0. Equivalently, 

{F*Gy=TG,i-r,F'+Tp,^G'. 

The proof of the proposition will be based on a lemma describing 
the behavior of the operator Tx^n and Mc under differentiation. 

Lemma 5.1.2. If K is a differentiable distribution function and 
if h is a differentiable function, then 

{TK,r,h)' = TK,r,h' + r]M^/{l-r,)hM^/^K' 

and 

Proof. If K is differentiable, then 

/Tjt 
hit - x)K'{x) Ax . 
-oo 

The chain rule yields 

^TK,r,h{t)= r h'{t-x)K'{x)dx + r)h{t{l-rj))K'{rit) 

which is the first statement. The second one is immediate. ■ 
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Proof (of the Proposition) . The tail of the convolution F * G is 



We integrate by parts and make a change of variable to obtain 



Combined with (5.1.1), we obtain the first assertion of the proposi- 
tion. 

To prove the second assertion, we proceed by induction, starting 
to prove the result for A; = 1. Using the lemma and diflferentiating 
the expression for F -kG, we see that 



Since F' = -F', we obtain F ★ G' = T^i-y^F' + Tp^^G'. 

Assume now that the relation holds for any integer up to A; — 1. 
Using the lemma. 




(5.1.1) 




\F{t - y){G{y) - + / G{y) dF{t - y) 

Jt(l-ri) 




YTG' = TG,i-r,F' + Tp^nG' + (1 - r?)Mi/^FMi/(i_^)G' 

+ vMi/(i-r,)GMi/^F' + riM^,^F'M^/^^_^)G 
+ (l-?7)Mi/^FMi/(i_^)G'. 



(F^^'-^^y = TG,i-r,F^'^ + Tp^^G^^^ 



+ (l-r?)Mi/^F('=-i)Mi/(i_,)G' 
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which after collecting the terms give the proper expression for 

5.2. Organizing the proof. The proof goes essentially by induction 
on k, and for fixed k by induction on n. We write Gn the distribution 
funciton of Yli^i<n^i^i ^^'^ ^ ^^^^ (c, We also write Fj 
for Mc^F, that is for the distribution function of CjXj. Hence, 

Gn = Fi -k ■ • ■ -k Fn. 

We also define a paramater p in (0, 1), which will be chosen at the 
end of the proof. We set d„ = c^. 

Applying Proposition 5.1.1, we see that 

GH'^ = Tn , 1— rf F^"^ + 7~p f/ '^1 

l^i^fe-l 

Let us write AmG^n'' the m terms asymptotic expansion of G^f ^ — or, 
more precisely, for the time being, the candidate for this asymptotic 
expansion — 

The '.4m' in this formula is not an operator; it is aimed as a short 
hand for 'm-terms approximation of and merely to help the memory. 
Sometimes we will omit the subscript m, writing simply A. 

We will approximate 7"G„_i,i-d„ by ^G„_i (Theorem 5.4.1) and 
7F„,d„ by Lp^. Thus, we expect an approximation of G'^n^ by 
Lg^_-^F^^^ + Lf„gI^}_-^. Since G^'l^^ is close to its asymptotic ex- 
pansion, we also hope to approximate Lp^G^^li by Lp^AG^^l-^^. But 



l^i^n— 1 



Now, Lf„Lg„_^^f, is not /-f„*(g„_iIifo (the latter being /-g„i,fJ; 
however, these two operators are equal up to differential operators 
involving D^+i+^'g for i nonnegative. Since f[^~^''^ x Id~'F^'^^ when 
^^(fc+O -g regularly varying, we expect that 



l^i^n— 1 
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Hence, we should obtain 

— (k) — (k) A — (k) 

which is equal to AGn . Thus, assuming that G)^_^ ~ AG)^_-j^, we 
can expect to prove G^^'' ~ AG^\ and build this way a proof by 
induction on n. In any case, this derivation shows that 

+ TF„,aAGi%-AGi%) 

l^i^n— 1 

- J2 /Wi/,„F(f)Mi/i_,„G£_7). (5.2.1) 
i^j^k-i 

In the right hand side of this equality, we control by assump- 
tions on F and the difference TG„_i,i-dr, ~ ^G„_i by Theorem 5.4.1. 
Since AG^^li is expressed in terms of functions Fi^s, hence, ulti- 
mately in terms of F, it is an explicit term on which we can work. 
The only term on which we do not have a rather direct control is 
Tp^^dniG^n-i ~ •^G^n-i)- Up to a shift of index n, it is related to 
the left hand side of (5.2.1), provided we can control the operator 
norm of TF„,d„ ■ This will allow us to prove the asymptotic expansion 
G^^ ~ AmG^^ is valid uniformly in n. 

For the induction and the estimates to be written in a manageable 
form, we use a pseudo-semi-norm to control the remainder terms. 
For any function h on the nonnegative half line, we define 

\h\m,r = sup nhit)\/F{t). 

The choice of this pseudo-semi-norm is motivated by the fact that 
lim^^oo \h\m,T = is equivalent to h{t) = o(t~"^F{t)) as t tends 
to infinity. Therefore, proving an asymptotic equivalence up to a 
t~"^F{t) term amounts to prove that the pseudo-semi-norm | • 
of some function tends to as r tends to infinity. 

5.3. Regular variation and basic tail estimates. In this sub- 
section, wc collect some facts on regular variation and on the distri- 
bution of {c,X). Our first lemma sandwiches the tail of {c,X). 
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Lemma 5.3.1. IfCp ^ 1, then 

Moreover, let e be a positive real number. There exists ts such that 
for any t larger than ts, 

G{t) ^ C,(i_^)_,F(t) . 
Proof. The first two bounds follow from the inequalities 

CiXi ^ CiXi H h CnXn ^ {c,X) . 

Next, if c^~^X„ ^ t for all n, then 

Y,CnXn^tY,< = tCp^t. 

Therefore, 

P{ {c,X)>t}^ P{ U„^i{ ci-'^Xn >t}} = J2P{ (i'^^n >t}, 

which is the last inequality in the first statement. This inequality 
asserts that G{t) is at most X]ra>i ^i^/^n~^)- Since Cp is at most 1, 
so are all the q's. Apply Lemma 2.2.4 with g = F, 6 = e/(l — p) 
and A = c^~^ to obtain the second statement. ■ 

This lemma will be useful when combined with the next analytical 
result. 

Lemma 5.3.2. Let g, h be two nonincreasing functions of bounded 
variations, such that g ^ h and 

lim g{t) = lim h{t) = . 

t— >00 t— >CXD 

Let f be a nonnegative nondecreasing and right continuous function 
onR+. Then 

-Jfdg^-J fdh. 
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Proof. Define the left continuous inverse of / by 



f^{u) = inf{x : f{x) ^ u} . 

Observe that f{x) ^ u ii and only if f^{u) ^ x. We use the Fubini- 
Tonnelli theorem to write 

/ fdg= / I{u^f{x)}dudg{x) 
Jo Jo Jo 

1 /"CXD 

/ I{x^ r{u)}dg{x)du 
Jo 

/•oo 

= - / gof^{u)du. 
Jo 

The result follows from the inequality g o ^ ho f'~ . ■ 

Since G, Gn, Fi and F are of the same order, so are their 
truncated means x^ dK{x) for K = G, Gn, F^ and F. Order 
is related to asymptotic behavior, and because we will need to have 
estimates that are uniform over n, we need a quantitative statement 
comparing truncated means. The following will do for our purpose 
and may be useful in other contexts. 

Lemma 5.3.3. Let F be a normalized regularly varying function 
of index —a. Let S be a positive number. There exists t4 such that 
for any < u ^ v, any t ^ t^, any integer k < a, 

/ x^dMuF(x)^—--v''(-] t'^Fit). 
Jtv OL-k \vJ 



Proof. A change of variable yields 

/"OO /"OO 

/ x'' dMuF{x) =u^ x^ dF{x) . 

Jtv Jtv/u 

By Karamata's theorem for Stieltjes integrals (Bingham, Goldie, 
Teugels, 1989, Theorem 1.6.5), there exists a t'^ such that for t more 
than t'^ 

x'^dFix) ^ -^^t^F{t). 
a — k 
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This ^4 may be taken independent of A; since there is only a finite 
number of integers less than a. Since vju ^ 1, this implies that for 
t at least i'^^ 

/ dM^F{x) ^ -vH''F{tv/u) . 

Jtv Oi-k 

By Lemma 2.2.4, if t ^ ta, we have F{tv/u) ^ {u/v)°'-^F{t). Take 
^4 = i2 V t'^ to conclude. ■ 

Lemma 5.3.4. Let F he a normalized regularly varying function 
with index —a. Let e he a positive number. There exists t^ such that 
for any t ^ t^, any n ^ 1, any sequence (c„)„^i with Cp ^ 1, and 
any k < a, 

x^ dGn{x) ^ x^ dG{x) ^ ^—^ C^^,_p)_,t''F{t) . 

Proof. Combining Lemmas 5.3.1 and 5.3.2, we have 

/ x''dGn{x)^ x''dG{x)!^^ x''dM^i-pF{x), 
Jt Jt ^^Jt 

where we used that Cp ^ 1 in the last inequality. Since Cp is at most 
1, so are all the c„'s. We apply Lemma 5.3.3 with 5 = e/{l — p) to 
obtain 

/ x^dM^^-,F{x) ^ ^^c(^-^)(«-'5H'=F(i) 
Jt ' ' a - A; " 

for t at least ^4 ■ 

We will also use the following bound on the moment of G. 
Lemma 5.3.5. Assume Cp is at most 1. For any s at least 1, 



Proof. Write 



fiG,s = s / x^~^G{x)dx. 
Jo 
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Apply Lemma 5.3.1 to obtain that the moment of order s of G is at 
most 



5.4. The fundamental estimate. The origin of our asymptotic ex- 
pansions is the following estimate, whose proof is almost deceptively 
simple. 

Theorem 5.4.1. Let m he a positive integer and let r he in [0, 1). 
Furthermore, let K he a distrihution function on the nonnegative half 
line, whose m-th moment is finite. If h is smoothly varying of order 
m + r, then 

\iTK,r,-LK,m)hm^ J] l^-M T dKix) 

Jo 



+ 



Proof. The expression of TK,ri and Proposition 2.2.5 show that 

rK,r,h(.t)- r Yl {-^y^h^'\t)dKix) 

Jo n^-^ J- 



/ (-\y^h^'\t)dK{x) = ^^{iiK)- \ x^ dK{x)\T)^h{t). 
Jo j! j! ^ ' ht ' 



Since 

'-xy:-.h^^)(t)dK{x) = - 

Irit 

the result follows from the triangle inequality. 

We could also bound (5.4.1) by the simpler estimate 

t-^\h^^\t)\Kl^{h^-^^)^iK,m+r. 



Unfortunately, this is not good enough for our purpose. 

Let us now explain why the estimate in the previous Theorem is 
useful. When h is smoothly varying and has index — /?, the term 
of smallest order in Lx^mh is given by /?/'"\ which is in i?V_^_m. 
If K is regularly varying with index —a, Karamata's theorem for 
Stieltjes integrals (Bingham, Goldie and Teugels, 1989, Theorem 
1.6.5) shows that the function 1 1— di^(a;) is in RV-oi+i- Thus, 
h^^\t) X* dK{x) is regularly varying with index — a— /5; this index 
is smaller than —f3 — rn if m < a. Thus, Theorem 5.4.1 proves that 
when h is smoothly varying, TK,rih ~ Lx^mh, and, moreover, gives 
an estimate of the error term of this asymptotic expansion. 

5.5. Basic lemmas. The goal of this subsection is to give estimates 
for the first three terms of the right hand side of (5.2.1). 

Our first lemma takes care of the term ( TG„_^,i-d^ — LG„-i,m)Fri''- 
It asserts that it is of smaller order than t~'^~^F{t), uniformly in n 
and in some sequences (cn)n^i- We write v{t) a function such that 
^ v[t) ^ t for all nonnegative t, and limt^oo v{t) = +oo while 
\im.t^oov{t) jt = 0. We assume moreover that v{t)/t is ultimately 
nonincreasing. For instance, v{t) = with < k < 1 will do. 

Lemma 5.5.1. Let e he a positive number. Assume that F is in 
SR-a,m+r+k With m an integer, r in [0, 1) and m + r smaller than 
a. There exist M and t^ depending only on F, m, k and e such that 
whenever Cp V C{i-p){^m+r) ^ 1? o-nd whenever dn ^ 1/2, for any t 
at least tQ, 

|(7G„_i,l-d„ - l-G,,-i,ni)F^J'^\k+m,t 



Proof. Applying Theorem 5.4.1, we obtain for t at least 1, 




(a;,,(,)/,(f('=+-)) + v{tr+^F o vit)) 



|(7-G„_„l-d„-/-G„_„™)FW|(0 





X 



^dGn-i{x). (5.5.1) 
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Since the Cj's are all at most 1, it suffices to prove the result for e 
small enough. Thus, we can assume that m + r is at most a — e. 

Let 5 = e/{2 — p). We can assume that e is small enough so that 
(1 — p)a — 5 is at least (1 — p){m + r). Then, the sum C„(i_p)_5 
is at most C(i_p)(^_|_j.), hence at most 1. Combining Lemmas 2.2.3 
and 5.3.4, we see that for t{l — dn) ^ ti V t^, 

f'OO 

■Jt{l-d„) 

Applying Lemmas 2.2.3, 2.2.6, 5.3.1 and 5.3.2, we also have, for t at 
least ti and t2-, 



Jo 

^McT't-^-'^F{t) f A;/,„,,/,(F('=+™))a;-+^dG(x). 
Jo 



We split the integral in this upper bound as one for x between and 
v{t), and one between v{t) and t{l — dn)- We then have the easy 
bound 

-'0 

We use Lemma 5.3.5 to bound fiG,m+r by C(^m^r){i-p)I^F,m+r} which 
is then at most Hr^m+r under the assumptions of the lemma. 

To bound the integral for x between v{t) and t{l — d^), we first 
bound A;/,„,,/,(F(^+-)) by A;/,„,i_^JF('=+-)). The latter is at 
most 



A;/e„,i/2(i^^'+"'^)+ sup sup y-^( 

s^t/c„l/2<\yKl-d„ \ 



+ 1 . 



If s is at least t/c„ and y at most 1 — dn, then s(l — y) is at 
least tdn/cn, and therefore at least t. Thus, by the standard Potter 
bounds, there exists tg such that for s at least ig, 



-y)) 



^ 2((1 - y)-°'-''-m-S V (1 - yycx-k-m+S^ 



^2d- 



<x — k—m—5 
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Consequently, 

f^' '"^ A:/,„,,/,(F(^+-))x-+^ dG{x) 

Jv{t) 

^ M(A;/,^,i/2(^^'+'"^) + d-^-'^-"^-' + 1) / x^+^ dG{x) . 

Jv{t) 

Since d„ is smaller than 1/2, we can simplify this upper bound into 

Jv(t) 

Applying Lemma 5.3.4, for v{t) at least is, this last quantity is at 
most 

Md-''-''-"'-^v{t)"'+''Fov{t) . 

It follows that 
Jo 

^ MA;,,(,)/,(f('=+-)) + Md-^-'^-^-'vitr+'^Fovit) . 

Combined with the other bounds, we obtain that the right hand side 
of (5.5.1) is at most 

Mc--H-'^-r-F{t) (t^F{t) + A;^,(,)/,(F('=+-)) 

Since m + r is smaller than a, the function s i— > s"^~^'^F{s) is ul- 
timately nonincreasing (Bingham, Goldie and Teugels, 1989, The- 
orem 1.5.3). Thus, for t large enough, V^F{t) is smaller than 
2v{t)'^^'^ F ov{t). The proof is completed in noting that d~°'~'^~"^~^ 
is at least 1. ■ 

Our next lemma shows that when dn is small, that is n is large, 
then Tp^^dn is very close to be a contraction. 

Lemma 5.5.2. There exists some positive numbers M and tj such 
that for any t at least t^, any positive n, any k, any dn smaller than 
1/2, any function h, 

\TF^,dr.h\k,t < \h\k,t{i-d^){'^ + Mdn). 
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Proof. A change of variable shows that 



TF„,dMt)= / h{t-CnX)dF{x). 

Jo 

If X is at most tdn/cn, then t — CnX is at least t{l — dn)- Consequently, 

\t,u M^lM F{t-c^x) ^ F{t{l^d^)) 

\h{t-CnX)\ ^ \h\k,t(i-d„) _ ^^^^k ^ |/^lfc,t(i-rf„) tk(^i_^^Y ' 



This implies 



,t(l-d„) ^7-7 (t-flnj • 



Since dn is at most 1/2, we can apply Lemma 2.2.4, and then bound 
(1 - by 1 + Mdn. 

Remark. In proving Lemma 5.5.2, our improved Potter bound is 
crucial. With the usual one we could only get A{l+Mdn) for some A 
greater than 1. This is not good enough for the inductions to come. 
Extensive attempts to prove our theorem under weaker assumptions 
suggest that the behavior of the function c(-) in the Karamta 
representation (see Bingham, Goldie and Teugels, 1989, Theorem 
1.3.1) of F cannot be arbitrary for our asymptotic expansion to 
hold. In particular, the asymptotic behavior of c(-) plays a key 
role in the asymptotic expansion. This is already the case for a 
two terms expansion where the second term involves derivative; one 
should indeed remark that the absolute continuity of the function 
c(-) is equivalent to that of F. 

In particular, in connection with the second term in (5.2.1), we 

— (k) A — (k) 

obtain the following estimate, considering h = G)^_^ — AmGnli in 
Lemma 5.5.2. 



Corollary 5.5.3. There exist positive numbers M andtg such that 
for any t at least tg and any sequence (c„)„^i with (dn)n^i uniformly 
bounded by 1/2, any k and any n at least 2, 

|'?"F„,d„(Gi*^l - AniGl^li)\k+m,t 

^ l^^i-l - -^mG^-l|fc+m,t(l-d„)(l + Mdn) ■ 
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This estimate shows the need to introduce the family of operators 

Tx.ri and not use as in Barbe and McCormick (2005). Indeed, 

when doing the induction later, we see that the value of t in the norm 
of the right hand side drops by a factor 1 — dn- When applying this 
bound inductively, we will obtain something like 

10-2 -A(J2 \k+m,t^^^^^„{l-di) ■ 

If ni>i(l ~ (^i) = 0) wil^ "^ot be able to permute the limits as n 
tends to infinity and t tends to infinity. It is therefore essential that 
the series Yln^i converges. 

Our last lemma in this section will handle the third term in the 
right hand side of (5.2.1). 

Lemma 5.5.4. Let e he a positive number at most a — 1. Assume 
that F is in SR-a,m+k+r- There exist positive M and tg such that 
for any sequence (c„)„^i with Cp at most 1, any t at least tg and 
any n at least 2, 



k+m,t 



l^i^n— 1 

m(c^(i-^)- + clKldSF^''^"'^))v{tr^''Fov{t) 

+ mc;a;,,^,(,)/,(f('=+-)). 



The proof of this lemma requires an auxilliary result which we 
state as a claim. It compares Tk^t^Lh with Lk*h (cf. subsection 
5.2). 

Claim. For any nonnegative t, 

\TK,7il-Hh- LK*Hh\{t) 



s' 

S' \ j / " I J. 

|/j(™)(t)| /rn\ 



+ 



E (""V^'^- /' K^/tih^"'^)^"'^'"-' dK{x) 
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Proof. By linearity of TK,n we have 

(—1)-' 

TK,nl-H = —j\—tJ'H,jTK,r,^^. 

Applying Theorem 5.4.1 to h^^^ in the form of a bound for | TK,r)h^^^ — 
l-K,m-jh^^A-> we obtain 



TK,-qLH,mh— ^ 7^ — IJ,H,jl-K,m-jh^-'^ {t) 



Using Lemma 2.1.4, the left hand side is the absolute value of 
{Tk.tjI-h — LKi,H)h evaluated at t. Setting s = I + j, the right 
hand side is at most 

- ^ {E^ (7) ™. I" ^M/.(*'"')x"'-' m^)) . 

This is our claim. ■ 
Proof (of Lemma 5.5.4). First the triangle inequality implies the 
pointwise inequality 



l^i^n— 1 

^ E l^^™,c«„/-G„_.hF,Ff -/.G„^F,Ff |. (5.5.2) 
l^j^n— 1 

Since F„ ★ (G„_it|Fj) = Gn\\Fi, the claim yields for t at least 1, 

« E ^^V^ E (^)M«._„«,J"'x'-dF„W 
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E C;).o.-... (-.3) 



rd„t 

X 



Jo 



Since we assume Cp to be at most 1, all the c„'s are at most 1. From 
Lemma 2.2.3, we deduce that for t at least ti, 

Moreover, HG„-ii]Fi,j ^ /^G,r But fiQj is a fixed polynomial in the 
Ci's and fip^s, 1 ^ / ^ j. Since all these C/'s are at most Cp, 
we conclude that HCn-AFi,] is at most some fixed constant M; this 
constant does not depend on n and sequences (c„)„^i with Cp ^ 1. 
Lemma 5.3.3 implies that for any t at least ti, 

It follows that the sum in the first term of (5.5.3) is at most 

^ Mt-''F{t)^cfc^^^-p'^-' . 

Similarly, for the second term in (5.5.3), we use the same bounds 
and Lemma 2.2.6 to obtain that it is at most 

McrH-'^-'^F{t) max / ^,/,^^,/,iF^'^+^^)x^+^-^ dF„(x) . 

Using a change of variables, we rewrite the integral terms in this 
bound as 



td„/c 

rn+i — j 



/ A;/,^,,„,/,(F(^+-))x-+^-^dF(x). 
Jo 



As in the proof of Lemma 5.5.1, we split the integral in this bound 
as one for x between and v{t), and one between v{t) and tdn/cn- 
We have 



i 



v{t)_ _ 

A,/,^,,^,/,{F(''+^y)x^+^-^ dF{x) 
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and using Lemma 5.3.3 (with u = u = 1 in it), for v{t) at least ti, 

rtdn/c„ 

Jv{t) 

We conclude that for t large enough (5.5.3) is at most 

+ c;A[,,jF('=+™))<t)-+'"Fot;(t)) . 

Since m + r is smaller than a, the function s ^ s^~^^F{s) is 
asymptotically equivalent to a nonincreasing function (Bingham, 
Goldie and Teugels, Theorem 1.5.3). Hence, for v{t) large enough, 
i'"F(t) is at most 2v{t)'^+''F o v{t). Therefore, (5.5.3) is at most 

Mt-'=-'"F(t)cf-'(«(^-^)-"^ + c;A[_rf^(F('=+"')))v(i)™+^F o -y(i) 

We then use (5.5.2) to finish. ■ 
5.6. Inductions. Define 

Our proof of Theorem 2.3.1 consists in bounding 7m,n(t) uniformly 
in n. This is done by induction on n, and we first need to settle the 
case n = 2. 

Lemma 5.6.1. Take p less than a/{a + k). There exists a function 
rjo with limit at infinity, such that whenever di and d2 are at most 
1/2 and k + m < lo, 

7S(i)^%(i)- 

Proof. Proposition 5.1.1 shows that 

G2 = TF,,i-d,F2 + TF,,d,Fi + Mi/^^_d,)FiM^/d,F2 , (5.6.1) 
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while for k at least 1, 

- E ^mi-d^A'^ ■ (5-6.2) 

Let r be a nonnegative number less than 1 and lo — k — m. We use 
a slight modification of Lemma 5.5.1 with n equal 2 to obtain 

Permuting Fi and F2 yields an upper bound for the error committed 
in approximating T>2,d2^i''^ by Lp^^mF^i^ ■ 

Combined with (5.6.2), this proves the lemma when A; is 1. 

When k vanishes, since m is smaller than a, 

as t tends to infinity. Since Mi/d^F2 = M^i-pF this is uniform in di 
and d2 at most 1/2. Combined with (5.6.1), this proves the result 
for k vanishing. 

When k is larger than 1, let e be less than a{l — p) — kp. We use 
Lemma 2.2.3 to obtain 

l^i/d.:F«Mv(i-,,)F('=-^)|(t) 

= \c2'F^'Htd2/c2)c\-'F^''-'\t{l-d2)/c,)\ 

^Mt-^cf^-f^-'f-'F{t)t-''+^cr'F{t) 

which is at most Mt~^F{tY . We conclude as before. ■ 

The next step is to show that 7m,n can be bounded by induction. 
For this purpose, we need another bound that will control the sum 
involving the multiplication operators in (5.2.1). 

Lemma 5.6.2. Let k he at least 2. Let e he a positive real numher. 
Assume that all di 's are smaller than 1/2. There exist tg and M such 
that for any t at least tg, any positive integers j, k with j ^ k — 1, 

i^2 

^ Mt^F{t){C^_,,^^_p) + sup7j'rHt/2))C,_^(„+,)_, . 

i>2 
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Proof. Define 5 = e/{l — p). Under our assumptions, all the Cj's are 
at most 1. Consequently, di/ci is at least 1 and Lemma 2.2.3 (taking 
c to be 1 in that lemma) implies that for s at least ti, 

\M^,a;F^i\s)\ = cT^\F^^\sdi/ci)\ ^ cT^ M{sdi/ci)-^F{sdi/ci) . 

Applying Lemma 2.2.4, using again the fact that dj/cj is at least 1, 
we see that for s at least ti and i2, 

Since AoG^^~^^ = YliKi^i the triangle inequality yields 

Using again Lemma 2.2.3 and the fact that the Cj's are at most 1, 
we see that for s at least ti, 

^ Ms-^+^F{s){C^.e + supTiV'^ls)) • 

Consequently, since di is at most 1/2, we obtain that for t large 
enough, 

E sup s'+^ I My,;F^^ is) Mi/(i-,,) gS^IT^'^ (^) 

^ Msups"'F(s/2)(C„-5 + sup7j^-^'\s/2))C(,+„-5)(i-p)-i , 

the factor 1/2 in s/2 coming from the multiplication operator acting 
on g['^i^^ and our assumption that di is at most 1/2. One more 
application of Potter's bound allows us to replace F{s/2) by F{,s) in 
the upper bound. Since 70^^^ "'•'(•) is nonincreasing and s 1— > s"^F{s) 
is asymptotically equivalent to an ultimately nonincreasing function 
(Bingham, Goldie and Teugels, 1989, Theorem 1.5.3), we can remove 
the supremum in s in the above bound (and, of course, we increase 
M in doing that). ■ 
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Our next lemma shows that ^m,n{-) can be bounded by induction 
on k, whenever k is at least 2. We define 

r]^{t) = {v{t)/ty + v{tyFov{t). 

Lemma 5.6.3. Let e be a positive real number, and let k be a 

positive integer. There exist positive numbers M and tio such 
that for any integer n at least 2 and any sequence (c„)„^i with 

C^p V Cc,-(^a+k+m)p-e ^ 1 ^.^d dn ^ 1/2, 

li^Ut) ^ ^(i + , max snpj^^';r^\t/M))nm{t/M) 

+ M^i^^^,it/M). 
In the statement of this lemma, we agree that maxi^j^o is 0. 

Proof. For u positive, the inequality ^{h) ^ u'*'^ A] ^{h) holds. 
We will take r to be in this inequality and apply it in the bounds of 
the previous subsection. Under the assumption of Theorem 2.3.1, we 
also have lim 

supt^^ At_i/2(-P^''+™^) finite. Using (5.2.1), Lemma 
5.5.1, Corollary 5.5.3 and 5.5.4, we obtain that there exists M and 
t'lQ such that for any t at least t'^Q and any n at least 3, 

j^ilit) ^ Mcr^^+''+"^^p-^(^{v{t)/ty+v{trFovit)) 

+ 7£Li(i(l-(^n))(l + MdO 

+ M(c°(i-'')-^ + dlMtrr o vit) + Mcl{v{t)/ty 

Collecting the terms and using that all the c„'s are at most 1, 

jiUlit) ^ M(cr + cinvmit) 

+ 7^1-1 - dn)) (1 + Mdn) (5.6.3) 
+ Yl |Mi/,„n^)Mi/(i-,„)G£_7\+^,t. 

Taking t'lQ large enough, we can assume that rjm^-) is nonincreasing 
on [t'lQ, oo). Dropping the subscript m and superscript k temporar- 
ily, inequality (5.6.3) has the form 

7nit) ^ anit)+Jn-l{t{l-dn)){l + Mdn), 
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where a„(-) is the nonnegative and nonincreasing function on 
[iio,oo) given by 

a„(t) = M(cr + <'')vm{t) 

+ |Wi/d„F(f-^yWi/(i-rf„)G2_7)u+„,t. 
i^j^k-i 

For i + 1 at most n, define Ai^n = ni+i<j<n(^ ~ ^i) ^^'^ 
Bi,n = ni+i^j^n(l + Mdj). We also set = = 1. By 

induction, inequality (5.6.3) implies 

Set A = Hj^til-dj) and B = Hj^-^^il + Mdj). Since all the a„(-)'s 
are nonnegative and nonincreasing, we have 

7n(t) ^ X] + ^72 (t^) • 

The inequality log(l — x) ^ —2x for x nonnegative and at most 1/2 
implies 

A ^ exp(^-2 = cxp(-2Cp) , 

while the the inequality log(l + x) ^ x implies 

B ^ exp (5^Md,) =exp(MCp). 



Consequently, 



We also have 
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Applying Lemma 5.6.2, this bound is at most 

+ Ms^'Fis) (Cc«-e/(i-p) + max sup 7^"^') (s/2))C„_^(„+fc)_, . 

Since s"^F(s) is at most r]m{s) for s at least 1, this bound yields 
7„(t) C„_ 

xr?^(te-2^0 + e^^''72(ie-'''0. 

To conclude the proof, if Cpj is at most 1, so are all the Cj's and Cp 
is at most Cp^. ■ 

We need an analogue of Lemma 5.6.3 when k vanishes. For this 
purpose, we state the analogue of Lemma 5.6.2 in this case. 



Lemma 5.6.4. Assume that Cp is at most 1 and that all di 's 
are at most 1/2. For t larger than some tn, the following inequality 
holds: 

X] \Mi/diFiMi/^l_di)Gi-i\k+m,t ^ C^(i_p)_e*™^(i) • 

Proof. Set S = e/{l — p). Apply Lemma 2.2.4 to obtain that for s 

at least t2, 

Since di is at most 1/2, Lemma 5.3.1 implies 
which, by Lemma 2.2.4 is at most -M^X^„>iCn 

Pn« for s 

large enough. This implies the conclusion. ■ 
The next lemma is Theorem 2.3.1 stated in an other way. 
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Lemma 5.6.5. Let e be a positive number at most 1. There exists 
a function r]{-) with limit at infinity, such that, for any k and m 

with k + m smaller than lo and m smaller than a, any n at least 
2, and any t at least 1 say, any nonnegative sequence (ci)i^i with 
suPj^i di ^ 1/2 and both C^p and CQ_(„_|_fc_|_^)p_e at most 1, 

^ n{t) . 

Proof. For k = 1, Lemma 5.6.3 implies 

^^^lit) ^ Mrj^{t/M) + Mi^\{t/M) . 

The result follows then from the assumptions and Lemma 5.6.1. 

By induction on A;, Lemmas 5.6.3 and 5.6.2 imply the result for k 
at least 1. 

When A; vanishes, Lemma 5.6.4 and the same arguments as those 
in the proof of Lemma 5.6.3 show that 

1^2]n{t) ^ ^(C(l-p)(a-e) + l)^?™(t/M) + M7^°)2 + MC2(,_^)_^t-F(t) 

(compare with (5.6.3)). The result follows. ■ 

5.7. Conclusion. To obtain Theorem 2.3.1, it mostly remains 
to show that as n tends to infinity, 7m,n(^) converges to \G'^^'> — 
AmG''^^\k+m,t- This is achieved in two steps, one consisting in 

proving that the sequence of approximations converges, the other 
one in proving that the sequence of functions G^n^ converges to G^^\ 

Lemma 5.7.1. Assum,e that Ci-p and \c\oo are at most 1. Then 
there exists tt2 and M such that for any t at least tt2, 

Remark. For our purpose, it is enough that AmGn converges 
pointwise to AmG''^\ In order to simulate properly tail behavior, it 
would be desirable to have convergence in | ■ \k+m,t norm. 
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Proof. Prom the definition of the approximation and since both 
fJ-Gr.mfi AtGliFi,o equal 1 for i at most n, 

- E ^ E f^omj^'^'Fi ■ (5-7.1) 

Write F = y^,,^ .^ CjXj and i? = V , , c,X,-. Then, for 7 at 
least 1, 

1^1^ j 

Applying Lemma 5.3.5, we see that for any / at least 1, 

ER^ ^ -^Vf,/ ^ Y ' 

while for I less than j, by the same token and under the assumption 
of the lemma, 

EY^~^ ^ IJ,G,j-l ^ Ci^j_i)(^i_p)llF,j-l ^ IJ-FJ-l ■ 

Consequently, for j at least 1, 

For t at least ti, Lemma 2.2.3 implies 

|D^+'=Fi(t)| ^ Mcf-H-''-^F{t) . 
So, the first double sum in (5.7.1) is at most 
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To bound the second double sum, we use Lemma 5.3.5 to obtain, for 
j at least 1. 

Hence, the second double sum in (5.7.1) is at most 

This concludes the proof. ■ 

The next lemma is the only place where the boundedness and 
continuity of F^^^ is used. Its proof is an adaptation of that of 
Proposition 9.1.6 in Dudley (1989). 

Lemma 5.7.2. Assume that F is k-times continuously differen- 
tiable on (0, oo), and that F^''^ is bounded and in L^{dx). Then, 
lim„^oo Gri'' = C^*"^ pointwise. 

Proof. Write 

Gn{t)= [ F^{t-y)dGn\\F^{y). 
Jo 

Since F^'^) exists and is in L^{dx), so is Fi. Then 

Git\t)= f Ft\t-y)dGr.^F,iy). 
Jo 

But the sequence {Gn\\Fi)n^i converges weakly* to the continu- 
ous distribution function G\]Fi and since F^''^ is continuous and 
bounded, G^n\t) converges to 

f )(t - y) dG^Fi(y) = {F^ * {G[^F^)f\t) = ^^(i) . 

To obtain Theorem 2.3.1 when the Cj's are nonnegative, it remains 
to do some rewriting of Lemma 5.6.5. For this purpose, define the 
sets of nonnegative sequences 

= { C e [ 0, 00)N* : iV„,^,^ (c) ^ 1 } • 
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The following is exactly Theorem 2.3.1 but for the positive case and 
everywhere smooth distribution function. 

Proposition 5.7.3. Let F in SR-a,uj and let k, m be two 

nonnegative integers with k + m smaller than uj and m smaller 
than a. Let j be a positive real number smaller than both 1 and 
u — k — m. Assume that F^^") is countinuous and bounded. There 
exists a function ri{-) which tends to at infinity and a real number 
tis such that for any t at least ti3 and any sequence c in Cci^u),^ 



Proof. For e positive, define p = (1/2) A [a/{a + uj)). Let c be a 
sequence in Ca,oj,'y By definition of Ca,^:,^ the series Cpj is at most 
1. Moreover, by taking e small enough, C^-e is at most Cp^, hence 
at most 1. 

Since A; + m + 7 < w, we also have p<a/{a + ^ + k + m), that is 
a — p{a + fc + m) > p'y. Hence, for e small enough Ca-[a+k+m)p-e 
is at most 1. 

To conclude the proof, lemmas 5.7.1 and 5.7.2 show that 

G^'^) - AmG^''^ = lim Gl!^^ - AmOi^^ 

n— >cx) 

pointwise. But for any n at least 2 and any t at least ti, Lemma 
5.6.5 yields 

- A^Gi'\t)\ ^ r^{t)t-^-^F{t) . 
Hence the same inequality holds with G^''\ ■ 

6. Removing the sign restriction on the random variables. 

In section 5, we assumed that the random variables are positive. 
Our goal in this section is to remove this assumption. But we will 
keep the assumption that F^''^ and M-iF^^^ exist, are bounded and 
continuous on the whole positive half line. The basic argument 
consists in conditioning. To be specific, define the random set of 
all indices corresponding to a nonpositive random variable, that is 
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Write Hj for the distribution function of Xlie/ '"^^^ ^^^^ 
of YlieN*\i ^i-^i- ^+ (i"esp. F_) be the distribution function of 
Xi say, given that Xi is positive (resp. nonpositive) , that is 

F\ = F/F{0) on (0, oo) 

and 

F_=F/F(0) on (-00,0]. 

We write F+^i (resp. for Mc^F+ (rcsp. Mc^F_). Note that 

there is no ambiguity in this notation for when c is nonnegative, 
(MeF)+ = Me(F+) and (MeF)_ = M^{F_). Given 7, the results of 
section 5 can be apphed to both M-iHj and Gj, using respectively 
the distribution functions M_iF_ and instead of F. The 
distribution function of the whole series {c,X) is EHj -kGi. The 
identity 

Hji<Gi{t) = I Gi{t-x) dHi{x) , 

J — oo 

suggests the relevance to the operator 

UHh{t)= [ h{t-x)dH{x), 



in term of which Hj -kGj = Uhi Gj . We then need to prove the 
analogue of some of the results of section 5 on T^,?;, but now 
for the operator Uh- The first one which we will prove implies 
D'^UhG = UhG^^\ It is then clear how the proof of the asymptotic 
expansion for the distribution function K of (c, X) and its derivatives 
will go. Indeed, we will have 

(6.0.1) 

We will see that Uh is a contraction for the right norm. Hence, 
equality (6.0.1) combined with the results of section 5 gives the 
asymptotic expansion 

~ EUH.AmGf^ . 

We will be able to approximate Uhj by Lhj ■ Because the error term 
is bounded uniformly with respect to the sequence (cj)j^i, we will 
be able to permute expectation and asymptotic expansions. 
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6.1. Elementary properties of Uh- Since we are interested in 
expansions of derivatives, our first elementary result deals with the 

composition of the derivative and Uh- It asserts that those two 
operators commute whenever acting on sufficiently regular functions. 

Lemma 6.1.1. Let h be a function on the nonnegative half 
line with Lebesgue integrable k-th derivative, and such that for any 
nonnegative I at most k, 

lim /tW(t) = 0. 

t — >CxD 

Then, D'^Unh = Uu^^h almost everywhere. 

Proof. By induction it suffices to prove the result for k equal 1. We 
write 

UuKt) = -J jh\y- x)l{ y>t}dy dH{x) . 
The function Unh' is Lebesgue integrable for 

l\l h\y-x)dHix)\dy^ j J \h'{y - x)\dydHix) = \h'\L^^^,y 

Applying Fubini's theorem, 

UHh{t) = - / h'{y-x)dH{x)dy = - UHh'{y)dy. 

Jt J-oo Jt 

Since we proved that Unh' is Lebesgue integrable, it is almost 
everywhere the derivative of Unh. ■ 

In particular, if F^''^ is continuous and bounded and i is not in /, 
then the analogue to the expression obtained in the proof of Lemma 
5.7.2, is 

^k) ^ r _ y) dGj^F+,,{y) . (6.1.1) 

Jo 

— (k) 

Thus, Gj is bounded and integrable with respect to the Lebesgue 
measure. Moreover, since F is smoothly varying with negative 
exponent —a, its A;-th derivative tends to at infinity. Then (6.1.1) 
shows that tends to at infinity for any nonnegative I at most 
k. Consequently, 



Hj -kGi — Uhi Gj 
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Our next result allows us to replace Gj ' by its asymptotic 
expansion when looking for an expansion for Uhj G^P . 

Lemma 6.1.2. For any nonnegative t, the operator Uh is a con- 
traction with respect to the norms \ ■ \p^f 

Proof. Let ^ be a function whose | • |p_t-norm is finite. Since 
t>-^tP/ F{t) is nondecreasing on the nonnegative half line 



The integrand is at most |/i|p,t; so is the integral, for H is a 



6.2. Basic expansion of Uh- We now show that Uh has an 
expansion LH,m, and therefore behaves similarly to Tp^n- Indeed, 
the next lemma should be compared to Theorem 5.4.1. 

Lemma 6.2.1. Let m be a positive integer and let r be in [0, 1). 
Let H be a distribution funciton on the nonpositive half line with 
finite m-th moment. If h is smoothly varying of order m + r, then 




distribution function. 




+ H{-t/2)sup\h{s)\ . 



Proof. We first have the inequality 




^ H {-t/ 2) sup \h{s)\ . 
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Applying Proposition 2.2.5, we have 





-t/2 



The result follows. 



6.3. A technical lemma. Looking at equality (6.0.1), we need 
to approximate UHiAmG^P ■ The following result, which is the 
analogue to Lemma 5.5.4 will do. Since M-iHj has the same 
properties as the distribution function G studied in section 5, it 
satisfies the assumptions of the next lemma. Note that even if 
is not regularly varying, the assumption M-iF = 0{F) and Lemma 
5.3.1 — for its part which does not require regular variation — ensure 
that Hi still satisfies the assumption of the following Lemma. 

Lemma 6.3.1. Assume that there exist constants Mq and ti4 such 
that for any integer k less than a and any t at least ti4, 



and for any nonnegative integer j at mostm, the moments fJ^M-^Hj+r 
are at most Mq. Then, there exist a positive M and a ti^ such that 
for any G = *i^iFi as in section 5 (that is the distribution function 
of an infinite weighted sum of nonnegative random variables with 
nonnegative weights with the assumption of section 5 satisfied), for 
any t at least ti5, 



^ MMoC„_e(A;,,(,)/,(F('=+-)) + A;,i/2(F('=+-))t;(0'"+'-F(-z;(t)) 



The proof uses an auxiliary result which we state as a claim, very 
much as we did in the proof of Lemma 5.5.4. 
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Claim. For any nonnegative t, any distribution function H sup- 
ported on the nonpositive half line and K supported on the nonneg- 
ative half line, 



{UnLKh- Ln^Khlit) 
s\ 

"-S^ E (%•<■, f, A:,„,.(A<-))ixr-'-d/fw 



+ 



+ H{-t/2) ^sup|/i(^)(.)|. 
Proof. By linearity of Uh, 



UhLk= —j^I^k,jUh'D^. 



J- 



Applying Lemma 6.2.1 to bound {Uh — LH,m-j)^'' h, we obtain 



+ E ^i^H/2)sup|/.(^)(.)|. 

Again, Lemma 2.1.4 shows that the left hand side of this inequality 
is the absolute value of {UhLk — LH*K)h evaluated at t. Setting 
s = I + j, the right hand side is exactly the upper bound given in 
the claim. ■ 

Proof (of Lemma 6.3.1). The triangle inequality implies the point- 
wise inequality 



^1 
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^ Y,\UHLGl,F^,mF\'^ - LH.Gm,mFf\ . (6.3.1) 



The claim yields for any positive t, 



J-t/2 

+ H{-t/2) ^^^^sup|Ff+^')(s)|. (6.3.2) 

We use the same estimates as in the proof of Lemma 5.5.4. So, 
Lemma 2.2.3 yields 

\Ff^'\t)\ ^ Mcf-H-''-'F{t) , 

and we also have the moment bound 

In (6.3.2), the term 

f Al^^yM^'-^r-^^^ dH{x) 

J-t/2 

is rewritten as a sum of an integral over [ —t/2, —v{t)) plus an integral 
over [—v{t),0]. In this decomposition, the second integral is at most 

\,v{t)/t{F^'^~^"'^)fJ'M-iH,m-j+r , 

while the first one is at most 

^^^^^(^(fc+m)^ / |x|'"-J'+''di^(x). 
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By assumption, for t at least 2ti4, the inequality 




x\'-^ dH{x) ^ Mo{t/2y-^F{-t/2) 



holds true. It follows that for t more than some t'lj^, the right hand 
side of (6.3.2) is at most 

Mc'^-H-^F{t)F{-t/2) + Mc'^-H-''-"'-''F{t) (A"t^^^tyt(F^''+"'^) 

+ Al,/,(F('^+^'>)v{tr+^F{-vit))) 
+ MH{-t/2)c'^-H-^F{t) . 
Consequently, for t at least 2ti4 A t^4, (6.3.1) is at most 

MC^_,t-'^-^F{t) (t^F{-t/2) + A;,,(,)/,(F('=+-)) 

+ Al^/2(F^''+"'^)v{tr+''F{-vit))+t"'H{-t/2)^ . 

For t large enough, r^F{-t/2) is at most v{t)'^+'' F[-v{t)). This 
concludes the proof of the lemma. ■ 

6.4. Conditional expansion and removing conditioning. For 

any /, the distribution functions M-iHj and G/ have asymptotic ex- 
pansions given by the results of section 5. In particular, Hj satisfies 
the assumptions of Lemma 6.3.1 with a constant Mq independent of 
both I and the sequence c = (cj)j^i which Na^uj,-({c) at most 1. 

The result of section 5 shows that for some function 77(-) which 
tends to at infinity, for any t at least some tis, for any set / and 
any sequence c with A^a,aj,7(c) at most 1, 

where 

ieN*\I 

Next, Lemma 6.1.1 shows that Hi-kGj = UhiG\ , which 
justifies equality (6.0.1). Then, Lemma 6.1.2 and the result of section 
5 yield 
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Using Lemma 6.3.1, we conclude that there exists a function ry*(-) 
with hmit at infinity such that 



To calculate the expectation involved in the inequality, we rewrite 
it as 

or, equivalently, since the Xj's are independent and identically 
distributed, as 



Conditionally upon Xi being positive, Hj-kGi'^Fi J^ is the distribution 
function of Y2j>i '^i-^i given I. Thus, the Xj's being indpendent, 

E{LHj*Gi\\F+,i \ Xi>0) = LxliFi ■ 

Next, F{0)f!^1 = f|^^ on the positive half line, and so the expec- 

tation that we wanted to calculate is simply X/i>i l-K^FiFi . This 
proves Theorem 2.3.1 when the XiS may assume arbitrary sign and 
the constants Cj's are nonnegative and F is smooth. 

7. Removing the sign restriction on the constants. 

So far, we proved Theorem 2.3.1 assuming that the q's are 
nonnegative. To drop this requirement is now rather easy, but 
unfortunately requires some checking which is very much in the flavor 
of either section 5 or 6. So we will give the details only for part of 
the proof. In this section, we keep assuming that F^*'^ and M^iF^''^ 
exist, are bounded and continuous on the positive half line. 

We define the set J of all indices pertaining to a positive constant 
Cj, that is 

J = {ieN* : Ci>0}. 

Define G (resp. H) to be the distribution function of X^igjCjXj 
(resp. "^i^-^-x^j CiXi). The tail expansion of G^^^^ is given by the 
result of section 6. That of H^'^'' follows by the same token, since 

ieN*\J ieN*\J 
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Now, the distribution function K of (c, X) is the convolution G-kH. 

To obtain an asymptotic expansion oi G* H , we have two 
strategies. One is to decompose the distribution functions by 
conditioning with respect to signs, as we did in section 6; another 
one is to go more along the line of section 5. Both routes are about 
equal length, and we go for the latter. 

Our starting point is Proposition 5.1.1 which asserts that 

K = Tg,i/2H + Th,i/2G + M2GM2H 

and for a positive integer k, 

K^^^ = Tg,i/2^^'^ + Th,i/2G^''^ + M2G^'^ M2H^''-'^ . 

(7.0.1) 

7.1. Neglecting terms involving the multiplication opera- 
tors. Starting with (7.0.1), the purpose of this subsection is to 

show that an expansion of K^'^) can be obtained from the ones 
for Tq^ii2H^^'> and Tha/2G^'^\ or, equivalently, that the terms 
/W2G(*)M2^('=-*) can be neglected. 

Our first lemma is an analogue of Lemma 6.1.2. The operators 
are not contraction, but for our problems, they behave very much as 
if they were bounded, which is good enough. 

Lemma 7.1.1. There exists t\Q such that for any positive real 
number c and any positive t with {t/c) At at least tie, 

mh\p,t^{cp+"+'\/cp+"-')\h\p,t/2. 



Proof. We simply write 



{s/c)Ph{s/c) ^^ Fjs/c) 



-h{s/c) = ^ ; ; ' 



F{s) " ' ' F{s/c) F{s) 
from which we deduce 



\Mch\p,t ^ cf|/t|p,t/eSupF(s/c)/F(s) . 



We conclude in using Lemma 2.2.4. 
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Our next lemma states a rather obvious property of the norm 



Lemma 7.1.2. For any positive real p, q and t, 



\f9\p+q+m,t ^ \f\p,t\9\q,t SUPS'"F(S) 



Proof. It follows from the identity 

i,p+q+m p q 

f{s)g{s) = =-f{s) =-g{s) s"^F{s) 



F{s) " ' " ' F{s) " ' F{s) 



Our first two lemmas in this subsection imply the following bound. 

Lemma 7.1.3. Assume that the hypotheses of Theorem 2.3.1 hold. 
Suppose also that F^^^ exists, is continuous and hounded. Then, 
there exists a function ??*(•) with limit at infinity and a positive 
number tn such that for any t at least tn and any sequence c with 
^a,w,j{c) at most 1, 



l<i<k-l 



k+m,t 



Proof. The triangle inequality, Lemmas 7.1.1 and 7.1.2 yield for t 
at least 1, 



f{k-i) 

'l^i<fe-l 



^ ^ 2^+-+«+i|G'«|,,,/2|JT(^-')U_,,t/2 sup s-F(s). 

Prom the result of section 6, 

|G«-AG«kt/2^^(V2). 

Since 

neJ 
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the triangle inequality and lemma 2.2.3 imply that for t at least ti, 

\AoG^^\t)\^MY,cr't~'m- 

neJ 

Consequently, 

|G«kt/2^^(*/2)+MC„_e. 

We have a similar bound for |-H''''^~*''|A:+m,t/2- Since s"^F{s) = o(l) 
as s tends to infinity, the result follows. ■ 

7.2. Substituting H^''^ and G^*^ by their expansions. Looking 
at equality (7.0.1), we would like to use Theorem 5.4.1 to conclude 
that has asymptotic expansion Lq^H^^^ . This is not pos- 

sible since we do not know if H^^^ is smoothly varying — the prob- 
lem is not so much about the regular variation part of the smoothly 
varying condition, but more about the continuity of The 
trick is to replace first H'^^'> by its asymptotic expansion. Since the 
expansion involves explicitely F and its derivatives, we will be able 
to study the action of o^i the expansion. The first step is to 

show that Tq ii2 behaves like a bounded operator in our problem 
(though it is not.) 

Lemma 7.2.1. Fort at least ti, 

|7"G,l/2%t^2f+«+>|^,,/2. 

Proof. It follows the proof of Lemma 5.5.2. ■ 
This lemma and the result of section 6 imply 

\TgM2H^^^ - TG,l/2AmH^^\^m,t ^ 2^+-+«+S(V2) . 

Of course a similar inequality holds if we permute G and H. 

To conclude the proof of Theorem 2.3.1 when F is smooth, we 
write 

neN*\J 
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Since L}j\>^Fri,mF''n'^ involves derivatives of it then suffices to study 
the expansion of ^'^d have a good error bound in this 

expansion. This is now straightfoward. Indeed, write 



TG,i/2F^n^= I F^{t-x)dG{x)+ f'\^J:\t-x)dG{x) 

J -00 J-t/2 



We then bound 

-t/2 



/ FW(t-x)dG(x) ^G{-t/2) sup 

J -00 s^t/2 

^ M|c„|'=G(-i/2)t-'=F(-V2) , 



and we expand 



f/2 _ 

-t/2 



into LcmF^'^^ as we did in sections 5 and 6. 

This completes the proof of Theorem 2.3.1 when F^''^ is continu- 
ous and bounded. 

8. Removing the smoothness assumption. 

We now want to remove the assumption that F^'^^ exist, is 
continuous and bounded on the whole real line. 

In Theorem 2.3.1, the membership of F and M-iF to SR-a^u 
ensures that there exists some A more than 2 say such that F^^\ 
M-iF^'^^ exist, are continuous and bounded on {A, 00). Thus, 
we can write F = (1 — p)Fq + pFi where Fq is concentrated on 
{—A — 1,A+ 1) and Fi is concentrated on {—A, Ay, and such that 
F^''^ and /W_iFi'^'^) exist, are continuous and bounded on the whole 
real line. Let be a sequence of independent Bernoulli random 
variable with mean p. Let / be the random set of integer i for which 
ei is 1. Given I, let Gi be -^i^zxi^CiF and Hj be ★jg/Mc-Fo. Then 
*ieZ^CiFi is EGi-kHj. Since the q's are summable, the support of 
the distributions pertaining to Gj is included in |c|i[— ^ — 1,^+1] 
no matter what / is. it follows that on 2|c|i(A + 1, 00), 



Gi-kHj = TgjHj . 



The expansion for Gj ★ Hj follows from that of Hj using the same 
arguments that we used in sections 6 and 7. This concludes the proof 
of Theorem 2.3.1. 
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Appendix. Maple code. The goal in writing the following Maple 
code was to see to which extend the tail calculus described in 

section 3.2 could be automatized. With this code, the user enters 
a distribution function having an expansion on some power of 
and the integer rn occuring in Theorem 2.3.1. The program then 
generates the coefficients of the asymptotic expansion of Gc (with 
the notation of Theorem 2.3.1), assuming that the Cj's are positive. 

The example which we ran here is that of the Burr distribution 
in subsection 3.2. 

The tail F is oF (for 'overlined F'). One needs to specify the 
parameter a, which is named palpha and m. 

restart; with(LinearAlgebra) : 
pgainina:=10: ptau:=3/2: 
oF : = ( 1+ (t " (ptau) ) /beta) " (-pgamma) ; 
palpha :=ptau*pgainiiia; m:=4; 

We then expand the tail of F. We write the tail expansion as a 
polynomial of a; = 1/t. 

equiF:=subs(t=l/x, convert (asymptC oF , t , palpha+m) , 

polynom) ) : 

We build the set of powers of x involved in this expansion. 
index_set : ={} : 

for i from 1 by 1 to nops(equiF) do 
a:=op(i,equiF) : 

index_set :=index_set union {limit (log (a) /log (x) , 

x=inf inity)} : 

end do : 

power_list : =sort (convert (index_set , ' list ' ) ) : 

We complete this list by the augmentation procedure described in 
section 3.2. 

for i in op(index_set) do 

for j from i by 1 while j <= palpha+m do 

index_set :=index_set union {j}; 
end do; 
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end do; 

index_list : =sort (convert (index_set , ' list ' ) ) : 

Then we calculate the dimension of the vector space we will work 
with. 

vdim:=nops(index_list) : 

We calculate the vector pp. Unfortunately, with Maple, it is easy 
to work with polynomials, but it has no useful command to work 
with monomials of noninteger degree. That induces the following 
code where we obtained the monomials one by one. 

pF:=Matrix(vdiiii, 1 ,readonly=f alse) : 
equiF_tmp : =equiF : 

for i from 1 by 1 to nops(power_list) do 
a:=op(i,equiF_tmp) : 

xpower :=liiiiit(log(a)/log(x) ,x=infinity) : 
member (xpower, index_list , 'k') : 
pF[k,l] :=a/x"xpower : 
end do: 

The next step is to build the matrices T) and M.c-> which we call 
Dmat and Mcmat in the code. 

Dmat : =Matrix(vdim,readonly=f alse) : 
for i from 1 by 1 to vdim-1 do 
for j from i+1 by 1 to vdim do 

if evalb(index_list [j] -index_list [i] =1) 
then Dmat [j , i] : =-index_list [i] ; end if ; 
end do; end do; 

Mcmat : =Matrix(vdim,readonly=f alse) : 
for i from 1 by 1 to vdim do 

Mcmat [i,i] :=c"index_list [i] : 
end do : 

We construct the Laplace character of F in its matrix form Cp- 
The matrix is Lmat. 

Lmat :=Matrix(vdim,readonly=f alse) : 



119 



temp_mat :=Matrix(vdim,readonly=f alse) : 

for i from 1 by 1 to vdim do temp_iiiat [i , i] :=1: end do: 

mu[0] :=1: 

for k from by 1 to m do 

Lmat: = (Lmat+((-l)~k*temp_mat*(c''k)*mu[k] /k! )) : 

temp_mat : = (temp_mat . Dmat) : 
end do : 

Its inverse is 

Lmat_inv : =MatrixInverse (Lmat ,method= ' subs ' ) : 

We write the expansion for G as Cq Y^ieZ ^f^P m .f - calculate 
the generic summands i^^^Pj^- 

Msum : =Lmat_inv . Mcmat . pF : 

To sum these summands amounts to substitute by Cp in this 
sum, we we do now. 

for i from 1 by 1 to vdim do 

Msiim[i,l] :=expand (collect (Msum [i,l] ,c) ,c) : 
end do: 

for i from 1 by 1 to vdim do 
a:=Msum[i, 1] : 

for j from 1 by 1 to nops(a) do 
if is ( c in indets(op(j ,a)) ) 
then 

p:=limit(log(op(j ,a))/log(c) ,c=inf inity) : 
Msum [i, 1] :=subs(c"p=C [p] ,Msum[i, 1] ) : 
end if : 
end do: 
end do: 

To calculate the Laplace character of Gc, we first obtain its 
moments. The algorithm is that described in Barbe and McCormick 
(2005). These moments are coded as muG[k] . 

for k from by 1 to m do 
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Q[k] :=t"k*c~k*mu[k]/k! : 
end do : 

Pl:=add(Q[k] ,k=0. .m) : 

P2 : =convert (series (In(Pl) ,t=0,m+l) ,polynoiii) : 
P3 : =add (C [k] *coef f (P2 , c , k) , k=0 . . m) : 
P4:=convert (series (exp(P3) ,t=0,m+l) ,polynom) : 
for k from by 1 to m do: 

muGEk] :=k! *coeff (P4,t,k) : 
end do : 

We construct the Laplace character of G. 

LGmat :=Matrix(vdim,readonly=f alse) : 

temp_mat : =Matrix(vdiiii,readonly=f alse) : 

for i from 1 by 1 to vdim do temp_mat [i , i] :=1: end do: 

for k from by 1 to m do 

LGmat : = (LGmat+ ( (-1) "k*temp_mat*muG [k] /k! ) ) : 

temp_mat : = (temp_mat . Dmat) : 
end do: 

And finally obtain the coefficient of the tail, that is p^. 
tail : =LGmat . Msum : 

In our example for the Burr distribution, these coefficients are 
messy. The remaining code makes them nicer looking; at least 
looking good enough so that they can be written as we did. 

The first step in the simplification is to substitute the centered 
moments for the noncentered ones. In the code, we write kappa [k] 
the A;-the centered moment. We express it as a function of the 
noncentered ones. 

for k from 1 by 1 to 5 do 

kappa [k] :=sum( ' (-1) ~ j*mu [j] * (mu[l] ~ (k-j) ) 
*binomial (k , j ) ' , ' j ' =0 . . k) : 

kappa [k] : =eval (kappa [k] ) : 
end do: 

Then we solve inductively for the noncentered moments, thereby 
expressing them as functions of the centered ones. 
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for k from 2 by 1 to 5 do 

mu[k] : = [solve (kappa [k]=s[k] ,mu[k])] [1] ; 
end do : 



Finally we do the substitution and arrange the terms by powers 
of ^. 

for i from 1 to vdim do 

tail [1,1] :=collect (collect (simplify ( 

expand (tail [i , 1] ) ) ,beta) ,mu[l] ) ; 

end do; 

Acknowledgements. Philippe Barbc thanks Peter Haskell and 
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